-- Logs begin at Wed 2022-09-28 15:01:24 UTC, end at Wed 2022-09-28 16:14:57 UTC. -- Sep 28 15:34:10.925845 dv-cinder-859316-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 15:34:10.933753 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 15:34:10 2022] *** Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: nodename: dv-cinder-859316-1-iscsi Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: machine: x86_64 Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: clock source: unix Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: pcre jit disabled Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: detected number of CPU cores: 4 Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: current working directory: / Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: detected binary path: /usr/bin/uwsgi-core Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: your processes number limit is 47680 Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: your memory page size is 4096 bytes Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: detected max file descriptor number: 2048 Sep 28 15:34:10.936925 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: lock engine: pthread robust mutexes Sep 28 15:34:10.937796 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: thunder lock: enabled Sep 28 15:34:10.937796 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 15:34:10.937796 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 15:34:10.976918 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: Python main interpreter initialized at 0x55e92525a9c0 Sep 28 15:34:10.976918 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: python threads support enabled Sep 28 15:34:10.976918 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: your server socket listen backlog is limited to 100 connections Sep 28 15:34:10.976918 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: your mercy for graceful operations on workers is 90 seconds Sep 28 15:34:10.977277 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 15:34:10.977358 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: *** Operational MODE: preforking *** Sep 28 15:34:10.977599 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: *** uWSGI is running in multiple interpreter mode *** Sep 28 15:34:10.977599 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: spawned uWSGI master process (pid: 111970) Sep 28 15:34:10.977802 dv-cinder-859316-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 15:34:10.978461 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: spawned uWSGI worker 1 (pid: 111971, cores: 1) Sep 28 15:34:10.979280 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: spawned uWSGI worker 2 (pid: 111972, cores: 1) Sep 28 15:34:10.979280 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 15:34:11.641695 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 15:34:11.642269 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 15:34:12.727418 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:34:12.727418 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: from cryptography.utils import int_from_bytes Sep 28 15:34:12.728006 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:34:12.728006 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: from cryptography.utils import int_from_bytes Sep 28 15:34:12.728817 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:34:12.728817 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: from cryptography.utils import int_from_bytes Sep 28 15:34:12.729267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:34:12.729267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: from cryptography.utils import int_from_bytes Sep 28 15:34:15.205801 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 15:34:15.206996 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 15:34:15.207137 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 15:34:15.207365 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 15:34:15.207760 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 15:34:15.207847 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 15:34:15.207847 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 15:34:15.208011 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 15:34:15.208116 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.208244 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 15:34:15.208437 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.208537 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 15:34:15.208754 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.208871 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.209070 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.209197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.209396 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.209518 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.209703 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.209835 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.210023 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.210163 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.210337 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.210493 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.210695 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.210818 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.210948 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.211134 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.211257 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.211461 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.211580 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859316-1-iscsi {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.211722 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.211898 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.212036 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.212206 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.212400 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859316-1-iscsi {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.212520 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.212687 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.212813 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.212994 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.213114 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.213303 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.213429 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.213620 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.213715 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.213924 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.214211 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.214329 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.214572 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.214695 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.214964 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.215106 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.215276 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.215406 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.215610 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.215750 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.215920 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.216007 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.216227 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.216325 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.216544 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.216631 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.216851 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.216940 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.217170 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.217308 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.217474 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.217563 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.217798 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.217953 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859316-1-iscsi {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.218103 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.218206 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.218488 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.218578 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859316-1-iscsi {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.218800 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.218890 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.219120 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.219207 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.219433 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.219537 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.219796 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.219889 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.220113 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.220202 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.220433 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.220518 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.220735 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.220829 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.221060 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.221163 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.221363 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.221453 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.221676 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.221771 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.222015 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.222104 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.222334 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.222478 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.222645 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.222749 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.222951 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.223051 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.223256 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.223349 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.223556 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.223642 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.223858 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.223953 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.224107 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.224204 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.224411 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.224499 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.224687 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.224773 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.224994 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.225087 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.225313 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.225409 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.225570 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.225720 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.225803 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.225942 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.226119 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.226208 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.226447 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.226565 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.226752 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.226855 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.227053 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.227145 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.227354 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.227442 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.227656 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.227745 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.227957 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.228064 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.228257 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.228357 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.228557 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.228646 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.228858 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.228946 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.229159 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.229244 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.229463 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.229559 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.229781 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.229874 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.230085 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.230178 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.230401 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.230519 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.230733 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.230881 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.231050 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.231193 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.231354 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.231443 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.231677 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.231762 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.231985 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.232081 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.232287 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.232380 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.232600 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.232688 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.232919 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.233116 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.233210 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.233292 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.233512 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.233610 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.233814 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.233910 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.234126 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.234212 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.234453 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.234580 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.234769 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.234864 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.235014 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.235110 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.235312 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.235400 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.235613 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.235702 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.235917 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.236016 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.236215 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.236302 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.236519 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.236622 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.236818 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.236906 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.237114 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.237200 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.237415 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.237503 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.237740 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.237828 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.238041 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.238138 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.238346 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.238464 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.238671 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.238765 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.238969 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.239066 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.239267 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.239357 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.239569 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.239671 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.239872 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.239968 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.240170 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.240255 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.240473 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.240557 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.240778 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.240877 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.241082 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.241189 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.241386 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.241502 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.241685 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.241783 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.241987 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.242076 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.242291 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.242378 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.242621 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.242829 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.242974 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.243125 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.243270 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.243406 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.243544 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.243704 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.243841 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.243978 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.244123 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.244269 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.244407 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.244556 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.244696 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.244842 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.244989 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.245137 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.245285 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.245425 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.245574 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.245713 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.245857 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.245997 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.246144 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.246284 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.246456 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.246675 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.246836 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.246976 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.247127 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.247267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.247416 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.247554 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.247692 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.247829 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.247982 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.248122 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.248260 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.248396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.248533 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.248670 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.248816 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.248966 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.249104 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.249204 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.249333 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.249431 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.249637 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.249725 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.249945 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.250036 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.250260 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.250357 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.250604 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.250691 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.250923 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:34:15.251012 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.251260 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.251355 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.251571 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.251669 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.251901 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.251997 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.252220 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.252316 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.252533 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.252618 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.252841 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.252938 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.253659 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.253763 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.253986 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.254074 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.254297 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.254384 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.254632 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.254729 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.254943 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.255038 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.255253 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.255347 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.255567 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.255744 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.255888 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.255977 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.256199 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.256285 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.256514 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.256602 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.256829 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.256930 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.257136 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.257225 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.257450 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.257547 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.257759 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.257852 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.258078 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.258178 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.258386 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.258562 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.258747 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.258885 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.259060 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.259183 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.259390 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.259504 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.259713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.259828 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.260034 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.260158 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.260342 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.260457 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.260651 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.260765 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.260957 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.261082 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.261268 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.261390 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.261620 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.261759 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.261896 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.262022 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.262193 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.262329 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.262509 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.262648 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.262895 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.263044 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.263170 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.263303 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.263428 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.263551 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.263731 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.263868 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.264499 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.264588 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.264669 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.264759 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.264759 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.264906 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.264994 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.265075 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.265262 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.265362 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.265575 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.265662 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.265883 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.265976 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.266198 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.266295 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.266531 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.266623 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.266845 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.266967 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.267155 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.267257 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.267455 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.267554 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.267756 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.267856 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.268056 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.268154 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.268359 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.268455 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.268658 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.268758 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.269527 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.269633 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.269837 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.269926 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.270161 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.270260 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.270508 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.270599 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.270817 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.270906 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.271129 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.271225 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.271437 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.271525 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.271748 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.271849 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.272051 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.272268 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.272357 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.272437 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.272652 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.272748 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.272967 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.273084 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.273280 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.273378 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.273586 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.273683 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.273888 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.273984 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.274205 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.274309 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.274531 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.274638 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.274836 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.274926 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.275141 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.275227 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.275449 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.275540 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.275759 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.275849 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.276069 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.276155 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.276374 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.276470 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.276685 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.276773 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.276994 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.277092 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.277301 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.277402 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.277624 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.277712 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.277935 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.278030 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.278241 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.278336 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.278585 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.278721 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.278908 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.278996 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.279222 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.279324 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.279525 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.279613 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.279837 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.279925 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.280139 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.280236 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.280443 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.280531 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.280745 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.280833 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.281048 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.281136 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.281348 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.281443 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.281651 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.281753 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.281952 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.282051 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.282250 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.282336 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.282574 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.282665 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.282883 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.282975 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.283184 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.283270 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.283482 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.283570 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.283784 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.283874 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.284083 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.284172 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.284398 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.284502 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.284719 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.284807 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.285061 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.285149 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.285367 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.285468 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.285704 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.285790 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.286024 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.286112 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.286333 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.286461 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.286680 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.286767 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.286995 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.287095 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.287312 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.287409 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.287624 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.287710 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.287931 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.288019 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.288238 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.288333 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.288544 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.288630 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.288858 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.288946 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.289167 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.289257 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.289484 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.289569 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.289787 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.289887 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.290108 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.290207 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.290429 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.290521 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.290745 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.290846 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.291053 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.291144 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.291371 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.291459 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.291697 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.291783 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.292016 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.292105 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.292325 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.292421 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.292637 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.292739 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.292945 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.293032 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.293250 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.293345 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.293556 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.293653 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.293861 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.293949 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.294170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.294256 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.294495 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.294599 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.294813 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.294900 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.295116 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.295210 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.295432 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.295528 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.295735 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.295821 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.296048 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.296137 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.296348 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.296450 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.296659 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.296747 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.296959 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.297045 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.297274 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.297363 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.297592 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.297678 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.297902 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.298030 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.298220 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.298307 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.298547 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.298638 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.298858 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.298947 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.299167 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.299254 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.299467 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.299554 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.299772 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.299861 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.300601 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.300698 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.300909 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.300997 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.301215 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.301312 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.301524 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.301619 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.301827 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.301915 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.302135 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.302235 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.302457 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.302549 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.302762 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.302857 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.303063 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.303442 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.303647 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.303734 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.303955 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.304042 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.304259 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.304355 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.304577 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.304665 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.304887 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.304973 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.305186 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.305281 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.305486 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.305574 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.305806 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.305894 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.306112 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.306199 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.306426 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.306515 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.306733 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.306820 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.307040 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.307170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.307348 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.307443 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.307633 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.307732 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.307961 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.308059 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.308282 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.308402 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.308581 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.308689 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.308896 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.308993 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.309198 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.309303 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.309505 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.309612 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.309810 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.309907 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.310118 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.310218 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.310437 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.310552 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.310747 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.310844 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.311056 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.311145 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.311363 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.311469 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.311668 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.311763 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.311974 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.312061 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.312286 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.312437 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.312583 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.312730 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.312868 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.313005 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.313177 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.313313 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.313480 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.313638 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.313783 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.313921 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.314072 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.314209 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.314376 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.314671 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.314761 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.315004 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.315271 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.315361 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.315604 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.315747 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.316462 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.316601 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.316785 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.316922 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.317134 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.317252 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.317459 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.317562 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.317790 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.317878 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.318125 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.318213 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.318458 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.318562 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.318770 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.318866 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.319071 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.319167 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.319379 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.319465 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.319680 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.319776 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.319985 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.320073 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.320288 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.320382 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.320594 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.320689 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.320896 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.320983 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.321202 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.321336 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.321506 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.321603 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.321810 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.321896 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.322114 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.322207 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.322430 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.322532 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.322749 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.322840 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.323052 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.323138 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.323364 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.323465 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.323670 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.323756 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.323972 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.324068 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.324277 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.324365 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.324578 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.324664 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.324884 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.324975 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.325189 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.325278 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.325528 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.325614 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.325834 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.325927 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.326169 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.326258 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.326494 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.326583 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.326802 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.326903 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.327124 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.327213 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.327428 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.327538 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.327736 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.327846 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.328038 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.328127 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.328341 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.328440 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.328646 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.328743 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.328947 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.329043 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.329255 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.329340 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.329558 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.329655 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.329865 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.329951 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.330172 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.330258 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.330493 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.330595 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.330802 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.330891 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.331104 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.331192 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.331442 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.331544 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.331752 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.331862 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.332055 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.332152 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.332357 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.332447 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.332663 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.332758 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.332967 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.333064 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.333268 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.333355 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.333576 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.333662 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.333876 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.333980 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.334185 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.334279 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.334508 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.334599 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.334822 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.334968 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.335118 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.335215 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.335423 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.335523 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.335727 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.335824 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.336026 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.336111 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.336333 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.336426 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.336638 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.336812 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.336938 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.337035 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.337241 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.337337 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.337549 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.337636 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.337849 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.337949 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.338149 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.338237 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.338477 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.338572 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.338784 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.338880 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.339096 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.339234 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.339396 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.339493 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.339704 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.339795 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.340007 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.340095 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.340311 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.340415 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.340611 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.340698 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.340918 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.341020 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.341217 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.341304 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.341518 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.341606 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.341817 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.341919 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.342118 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.342205 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.342454 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.342546 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.342742 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.342851 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.343044 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.343139 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.343344 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.343430 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.343647 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.343750 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.343949 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.344037 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.344251 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.344345 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.344553 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.344642 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.344892 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.344988 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.345198 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.345288 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.345509 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.345596 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.345827 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.345916 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.346137 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.346225 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.346464 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.346569 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.346779 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.346889 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.347108 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.347197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.347422 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.347510 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.347727 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.347814 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.348040 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.348140 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.348341 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.348429 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.348642 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.348731 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.348949 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.349045 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.349254 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.349342 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.349558 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.349645 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.349879 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.349989 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.350189 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.350278 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.350529 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.350640 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.350832 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.350931 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.351146 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.351242 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.351451 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.351545 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.351755 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.351856 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.352064 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.352154 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.352371 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.352458 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.352677 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.352802 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.352983 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.353078 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.353287 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.353381 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.353594 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.353684 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.353901 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.353989 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.354212 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.354309 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.354534 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.354626 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.354840 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.354926 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.355138 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.355227 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.355444 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.355539 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.355748 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.355835 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.356047 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.356143 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.356353 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.356448 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.356654 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.356743 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.356962 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.357069 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.357258 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.357354 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.357565 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.357683 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.357868 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.357994 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.358304 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.358395 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.358632 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.358733 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.358949 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.359054 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.359245 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.359340 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.359554 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.359652 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.359861 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.359957 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.360162 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.360247 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.360478 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.360565 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.360785 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.360880 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.361167 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.361262 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.361516 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.361687 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.363956 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.364489 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.365694 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.365784 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.365867 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.365946 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366026 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366095 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366162 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366242 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366321 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366429 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366514 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366594 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366686 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366776 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366858 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.366946 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367028 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367108 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367108 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367340 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367495 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367495 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367650 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367650 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367804 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367893 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367973 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.367973 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368115 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368184 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368274 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368367 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368450 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368530 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368618 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368699 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368778 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368857 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.368936 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369035 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369119 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369199 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369278 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369358 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369501 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369627 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369717 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.369938 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.370036 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.370240 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.370337 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.370583 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.370674 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.370910 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.371000 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.371222 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.371312 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.371542 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.371635 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.371857 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.371952 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.372179 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.372277 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.372549 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.372637 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.372870 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.372960 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.373193 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.373294 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.373497 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.373592 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.373798 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.373893 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.374106 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.374209 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.374437 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.374531 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.374731 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.374821 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.375037 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.375133 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.375340 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.375426 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.375647 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.375735 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.375954 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.376044 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.376258 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.376346 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.376559 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.376656 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.376860 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.376949 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.377166 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.377260 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.377467 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.377555 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.377784 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.377873 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.378096 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.378227 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.378974 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.379065 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.379295 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.379386 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.379619 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.379706 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.379939 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.380037 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.380246 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.380333 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.380548 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.380637 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.380852 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.380949 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.381159 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.381247 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.381467 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.381563 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.381773 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.381871 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.382088 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.382175 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.382440 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.382532 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.382753 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.382855 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.383059 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.383154 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.383389 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.383478 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.383700 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.383796 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.384014 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.384100 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.384322 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.384456 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.384639 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.384739 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.384955 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.385045 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.385255 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.385345 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.385555 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.385653 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.385860 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.385949 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.386159 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.386256 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.386479 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.386571 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.386783 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.386871 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.387088 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.387188 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.387383 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.387469 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.387681 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.387770 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.387980 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.388082 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.388283 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.388377 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.388585 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.388673 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.388899 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.388996 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.389203 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.389291 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.389502 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.389641 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.389802 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.389892 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.390120 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.390247 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.390401 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.390553 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.390727 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.390816 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.391069 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.391157 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.391374 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.391460 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.391693 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.391783 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.392001 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.392089 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.392310 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.392397 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.392623 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.392720 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.392937 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.393024 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.393245 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.393345 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.393558 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.393647 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.393892 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.393981 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.394201 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.394305 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.394536 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.394628 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.394848 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.394938 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.395160 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.395257 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.395474 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.395694 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.395783 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.396019 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.396313 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.396411 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.396627 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.396715 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.396938 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.397036 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.397248 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.397336 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.397556 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.397644 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.397866 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.397962 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.398176 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.398266 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.398515 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.398619 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.398819 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.398906 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.399129 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.399228 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.399439 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.399539 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.399768 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.399875 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.400090 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.400180 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.400405 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.400496 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.400718 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.400815 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.401035 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.401124 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.401348 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.401436 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.401663 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.401764 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.401980 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.402069 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.402287 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.402376 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.402629 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.402720 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.402943 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.403034 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.403256 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.403351 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.403566 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.403655 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.403873 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.403961 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.404181 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.404278 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.404490 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.404578 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.404801 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.404898 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.405107 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.405270 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.405417 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.405505 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.405726 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.405812 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.406036 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.406132 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.406351 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.406459 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.406695 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.406783 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.407006 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.407137 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.407317 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.407433 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.407631 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.407723 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.407943 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.408145 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.408262 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.408459 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.408781 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.408871 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.409100 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.409189 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.409440 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.409531 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.409757 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.409860 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.410075 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.410172 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.410391 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.410519 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.410717 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.410814 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.411027 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.411117 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.411336 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.411423 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.411639 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.411740 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.411939 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.412029 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.412246 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.412333 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.412549 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.412646 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.412847 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.412935 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.413164 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.413260 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.413471 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.413561 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.413793 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.413995 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.414085 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.414341 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.414645 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.414781 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.414991 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.415087 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.415309 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.415396 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.415622 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.415710 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.415928 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.416025 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.416249 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.416345 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.416553 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.416643 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.416856 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.416945 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.417168 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.417267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.417473 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.417560 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.417771 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.417857 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.418071 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.418170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.418379 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.418504 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.418706 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.418793 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.419007 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.419108 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.419313 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.419418 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.419613 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.419709 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.419921 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.420025 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.420223 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.420313 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.420521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.420624 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.420824 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.420928 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.421132 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.421218 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.421428 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.421523 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.421731 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.421828 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.422031 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.422117 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.422329 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.422438 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.422656 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.422748 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.422960 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.423054 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.423266 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.423354 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.423566 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.423667 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.423890 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.423986 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.424169 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.424267 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.424479 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.424568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.424796 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.424883 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.425623 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.425741 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.425927 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.426075 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.426224 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.426313 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.426562 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.426671 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.426867 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.426955 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.427180 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.427267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.427488 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.427590 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.427794 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.427882 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.428363 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.428457 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.428687 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.428778 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.429031 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.429213 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.429347 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.429542 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.429860 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.429956 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.430190 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.430278 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.430537 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.430627 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.430841 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.430931 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.431144 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.431234 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.431451 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.431538 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.431772 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.431862 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.432075 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.432186 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.432383 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.432479 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.432689 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.432781 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.432998 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.433089 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.433306 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.433448 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.433610 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.433697 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.433917 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.434013 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.434223 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.434319 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.434553 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.434649 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.434901 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.435042 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.435209 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.435305 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.435464 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.435552 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.435769 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.435858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.436076 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.436166 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.436382 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.436471 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.436691 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.436780 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.437008 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.437099 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.437319 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.437406 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.437631 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.437732 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.437943 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.438032 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.438247 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.438335 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.438578 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.438681 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.438885 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.438974 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.439190 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.439278 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.439498 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.439594 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.439807 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.439896 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.440115 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.440213 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.440419 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.440517 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.441282 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.441594 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.441682 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.441999 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.442274 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.442364 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.442615 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.442705 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.442939 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.443027 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.443261 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.443358 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.443571 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.443658 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.443879 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.443975 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.444201 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.444293 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.444508 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.444600 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.444829 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.444925 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.445141 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.445230 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.445470 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.445558 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.445790 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.445887 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.446094 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.446220 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.446400 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.446508 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.446724 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.446824 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.447031 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.447120 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.447349 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.447438 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.447657 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.447747 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.447959 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.448049 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.448261 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.448349 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.448569 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.448660 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.448869 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.448958 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.449171 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.449259 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.449473 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.449562 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.449774 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.449938 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.450082 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.450213 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.450377 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.450513 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.450720 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.450817 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.451025 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.451125 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.451323 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.451412 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.451626 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.451720 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.451923 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.452019 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.452224 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.452322 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.452524 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.452688 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.452827 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.452976 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.453116 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.453253 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.453397 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.453535 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.453686 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.453833 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.454010 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.454153 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.454329 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.454525 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.454666 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.454756 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.454988 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.455078 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.455297 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.455386 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.455615 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.455705 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.455967 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.456064 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.456251 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.456833 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.457056 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.457147 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.457369 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.457457 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.457676 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.457774 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.457989 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.458079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.458297 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.458385 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.458629 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.458743 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.458938 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.459035 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.459244 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.459333 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.459550 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.459649 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.459857 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.459945 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.460165 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.460254 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.460476 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.460578 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.460777 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.460873 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.461100 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.461190 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.461404 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.461493 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.461721 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.461816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.462033 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.462122 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.462340 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.462456 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.462682 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.462782 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.463032 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.463141 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.463290 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.463388 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.463595 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.463685 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.463902 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.464003 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.464208 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.464341 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.464515 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.464603 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.464818 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.465021 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.465113 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.465199 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.465423 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.465511 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.465728 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.465825 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.466044 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.466132 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.466359 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.466481 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.466689 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.466778 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.467012 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.467108 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.467322 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.467410 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.467646 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.467736 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.467958 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.468045 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.468296 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.468392 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.468613 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.468702 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.468921 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.469008 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.469232 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.469321 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.469536 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.469633 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.469776 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111972) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 15:34:15.469873 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.470157 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:34:15.470401 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 15:34:15.624613 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO dbcounter [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Registered counter for database nova_api Sep 28 15:34:15.624978 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO dbcounter [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Registered counter for database nova_api Sep 28 15:34:15.645330 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_db.sqlalchemy.engines [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:34:15.648481 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_db.sqlalchemy.engines [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111972) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:34:15.652729 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writer thread running {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:34:15.655092 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writer thread running {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:34:15.710368 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.context [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87116ee1-0fc8-49a7-9503-1c7e788a9bed(cell1) {{(pid=111971) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 15:34:15.712707 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.context [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87116ee1-0fc8-49a7-9503-1c7e788a9bed(cell1) {{(pid=111972) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 15:34:15.714152 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_concurrency.lockutils [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:34:15.714654 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_concurrency.lockutils [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:34:15.716220 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_concurrency.lockutils [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:34:15.716633 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:34:15.717052 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_concurrency.lockutils [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:34:15.717144 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:34:15.717501 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_concurrency.lockutils [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:34:15.718694 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:34:15.719430 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:34:15.719520 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_concurrency.lockutils [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:34:15.719885 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:34:15.721423 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO dbcounter [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Registered counter for database nova_cell0 Sep 28 15:34:15.722442 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:34:15.724431 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO dbcounter [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Registered counter for database nova_cell0 Sep 28 15:34:15.725949 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO dbcounter [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Registered counter for database nova_cell1 Sep 28 15:34:15.728448 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO dbcounter [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Registered counter for database nova_cell1 Sep 28 15:34:15.733590 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_db.sqlalchemy.engines [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:34:15.734848 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_db.sqlalchemy.engines [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:34:15.736694 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_db.sqlalchemy.engines [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111972) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:34:15.739644 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_db.sqlalchemy.engines [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111972) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:34:15.741525 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writer thread running {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:34:15.744600 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writer thread running {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:34:15.746772 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writer thread running {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:34:15.749714 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writer thread running {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:34:15.888979 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO dbcounter [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Registered counter for database nova_cell0 Sep 28 15:34:15.889792 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO dbcounter [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Registered counter for database nova_cell0 Sep 28 15:34:15.897874 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_db.sqlalchemy.engines [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111972) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:34:15.900628 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG oslo_db.sqlalchemy.engines [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:34:15.903714 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writer thread running {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:34:15.905631 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writer thread running {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:34:16.243889 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: WARNING keystonemiddleware.auth_token [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:34:16.248166 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: WARNING keystonemiddleware.auth_token [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:34:16.251309 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: WARNING keystonemiddleware.auth_token [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:34:16.256043 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: WARNING keystonemiddleware.auth_token [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:34:16.592092 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: WARNING keystonemiddleware.auth_token [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:34:16.597955 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: WARNING keystonemiddleware.auth_token [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:34:16.598966 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: WARNING keystonemiddleware.auth_token [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:34:16.603430 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e92525a9c0 pid: 111972 (default app) Sep 28 15:34:16.604900 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: WARNING keystonemiddleware.auth_token [None req-6833b16f-4a0b-4e7d-84a8-eb1bc5aa4f21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:34:16.605518 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:16.606709 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001702 Sep 28 15:34:16.607448 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Sep 28 15:34:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:16.610317 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e92525a9c0 pid: 111971 (default app) Sep 28 15:35:39.012387 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:39.013426 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 28 15:35:39.013828 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:39.025751 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writing DB stats nova_api:SELECT=3 {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:39.026732 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writing DB stats nova_cell0:SELECT=3 {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:39.027912 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writing DB stats nova_cell1:SELECT=3 {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:39.028681 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:39.896031 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-d540f5da-5fef-4bd3-8e03-774e35c5c1ed admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:39.931141 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-d540f5da-5fef-4bd3-8e03-774e35c5c1ed admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910453 Sep 28 15:35:39.932614 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 28 15:35:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:35:42.602521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:42.603538 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-5fc432f4-8d12-4773-9c5d-d9a2c74bac84 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Sep 28 15:35:42.603940 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:43.084342 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-1f8a6734-4d01-4ed8-97b1-99ddad80d3ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:43.131883 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-1f8a6734-4d01-4ed8-97b1-99ddad80d3ed admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521478 Sep 28 15:35:43.132447 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:35:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:35:43.147286 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_api:SELECT=3 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:43.148140 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_cell0:SELECT=3 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:43.151386 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_cell1:SELECT=3 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:43.152914 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:43.359318 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-ab4db1f4-3f6f-4879-bb06-e674ea3acbf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:43.431065 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-ab4db1f4-3f6f-4879-bb06-e674ea3acbf3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289620 Sep 28 15:35:43.431615 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 15:35:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:35:46.103291 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-1f8a6734-4d01-4ed8-97b1-99ddad80d3ed admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:46.104988 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-1f8a6734-4d01-4ed8-97b1-99ddad80d3ed admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002173 Sep 28 15:35:46.105401 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:46.759722 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-48a6c331-e811-42a3-85f9-066df9c6f391 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:46.804097 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-48a6c331-e811-42a3-85f9-066df9c6f391 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.691551 Sep 28 15:35:46.805541 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:35:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:35:46.819132 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-7a8769b2-a4c3-4a2b-99ec-c40f80f6f4ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:46.868454 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-7a8769b2-a4c3-4a2b-99ec-c40f80f6f4ae admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053399 Sep 28 15:35:46.869249 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 15:35:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:35:49.473011 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-48a6c331-e811-42a3-85f9-066df9c6f391 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:49.474050 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-48a6c331-e811-42a3-85f9-066df9c6f391 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 28 15:35:49.474468 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:49.911917 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-2ed6d95b-3941-45b9-97bd-97ae2586b5fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "swap": 0}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:49.931726 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-2ed6d95b-3941-45b9-97bd-97ae2586b5fb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450850 Sep 28 15:35:49.932507 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:35:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:35:49.945163 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-d5c66b7c-816d-4a9f-8cf9-9d93a0b2c511 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:49.973137 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-d5c66b7c-816d-4a9f-8cf9-9d93a0b2c511 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031562 Sep 28 15:35:49.973657 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 15:35:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:35:52.673675 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-2ed6d95b-3941-45b9-97bd-97ae2586b5fb admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:52.674705 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-2ed6d95b-3941-45b9-97bd-97ae2586b5fb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 28 15:35:52.675105 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:35:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:53.133597 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-3e9e5096-3d9f-4a5f-be16-e7a977f81b8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "name": "ds2G"}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:53.153291 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-3e9e5096-3d9f-4a5f-be16-e7a977f81b8e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471798 Sep 28 15:35:53.154600 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:35:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:35:53.167276 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-96caca63-1078-4d7b-b53e-d5d1cc20ad99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:53.195581 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-96caca63-1078-4d7b-b53e-d5d1cc20ad99 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032368 Sep 28 15:35:53.196255 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 15:35:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:35:55.875183 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-3e9e5096-3d9f-4a5f-be16-e7a977f81b8e admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:55.876201 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-3e9e5096-3d9f-4a5f-be16-e7a977f81b8e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 28 15:35:55.876609 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:35:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:56.358268 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-3c8be147-42cb-449e-a25d-69f1081e7d07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "disk": 20, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:56.377786 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-3c8be147-42cb-449e-a25d-69f1081e7d07 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494396 Sep 28 15:35:56.378288 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:35:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:35:56.391406 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-8f20d404-58b6-466c-8391-3dcf6fb2e482 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:56.415618 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-8f20d404-58b6-466c-8391-3dcf6fb2e482 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028683 Sep 28 15:35:56.416211 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 28 15:35:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:35:59.647173 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-3c8be147-42cb-449e-a25d-69f1081e7d07 admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:59.648560 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-3c8be147-42cb-449e-a25d-69f1081e7d07 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Sep 28 15:35:59.649200 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:00.214393 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-ebe65ecd-3d0b-4072-ae56-a7ca0089d15b admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:00.240043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-ebe65ecd-3d0b-4072-ae56-a7ca0089d15b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.581993 Sep 28 15:36:00.240620 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 28 15:35:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:03.165046 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-3c8be147-42cb-449e-a25d-69f1081e7d07 admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:03.166149 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-3c8be147-42cb-449e-a25d-69f1081e7d07 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 28 15:36:03.166580 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:36:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:03.572002 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-7f60718a-e8b6-4976-a212-a45b9c1cdaa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 1, "ram": 512, "id": "1", "os-flavor-access:is_public": true}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:03.592774 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-7f60718a-e8b6-4976-a212-a45b9c1cdaa1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.419292 Sep 28 15:36:03.593597 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:36:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:36:03.605688 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-c1258831-f142-4f32-8e81-5154fe10d10c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:03.633044 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-c1258831-f142-4f32-8e81-5154fe10d10c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031046 Sep 28 15:36:03.633622 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 15:36:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:36:06.248460 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-7f60718a-e8b6-4976-a212-a45b9c1cdaa1 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:06.249473 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-7f60718a-e8b6-4976-a212-a45b9c1cdaa1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Sep 28 15:36:06.249884 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:36:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:06.649011 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-6e0dcdba-fa0b-43cc-a6f3-bf6a52ab8884 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:06.668123 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-6e0dcdba-fa0b-43cc-a6f3-bf6a52ab8884 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411791 Sep 28 15:36:06.668925 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:36:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:36:06.682061 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-16f1b1c2-a472-4840-9d1b-3e49b93b5209 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:06.706962 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-16f1b1c2-a472-4840-9d1b-3e49b93b5209 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028521 Sep 28 15:36:06.707777 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 15:36:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:36:09.501144 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-6e0dcdba-fa0b-43cc-a6f3-bf6a52ab8884 admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:09.502814 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-6e0dcdba-fa0b-43cc-a6f3-bf6a52ab8884 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002065 Sep 28 15:36:09.503677 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:36:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:09.959040 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-679e61c6-8e61-4645-b2c9-f14074651db0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "swap": 0, "disk": 40}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:09.988401 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-679e61c6-8e61-4645-b2c9-f14074651db0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.478668 Sep 28 15:36:09.990477 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:36:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:36:10.001361 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-1fa82054-b256-49a0-ade1-5f3d860ab034 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:10.006591 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:36:10.036892 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-1fa82054-b256-49a0-ade1-5f3d860ab034 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039298 Sep 28 15:36:10.037513 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 15:36:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:36:12.649346 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-679e61c6-8e61-4645-b2c9-f14074651db0 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:12.650673 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-679e61c6-8e61-4645-b2c9-f14074651db0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 Sep 28 15:36:12.651101 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:13.121432 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-e0a13584-7458-44af-9a03-ef0c17b984dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:13.145656 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-e0a13584-7458-44af-9a03-ef0c17b984dd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.488282 Sep 28 15:36:13.146203 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:36:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:36:13.159019 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-28bdf424-6233-481a-bf69-c85b77334803 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:13.185787 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-28bdf424-6233-481a-bf69-c85b77334803 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030256 Sep 28 15:36:13.186433 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 15:36:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:36:15.817733 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-e0a13584-7458-44af-9a03-ef0c17b984dd admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:15.819358 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-e0a13584-7458-44af-9a03-ef0c17b984dd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Sep 28 15:36:15.819757 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:16.267267 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-14175725-4dca-47be-917f-5f7489382b83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:16.276464 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:36:16.292991 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-14175725-4dca-47be-917f-5f7489382b83 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467196 Sep 28 15:36:16.294170 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 28 15:36:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:36:16.306166 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-90d2ad35-32da-445e-bba5-a35467c0e526 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:16.334503 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-90d2ad35-32da-445e-bba5-a35467c0e526 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032075 Sep 28 15:36:16.338777 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 28 15:36:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:36:32.220744 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-14175725-4dca-47be-917f-5f7489382b83 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:32.221764 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-14175725-4dca-47be-917f-5f7489382b83 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 28 15:36:32.222167 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:32.233493 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:36:32.622624 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-f24e315b-972c-417b-91aa-15dd636d6323 admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:32.645427 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-f24e315b-972c-417b-91aa-15dd636d6323 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.416932 Sep 28 15:36:32.645981 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 28 15:36:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:33.942965 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-14175725-4dca-47be-917f-5f7489382b83 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:33.944446 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-14175725-4dca-47be-917f-5f7489382b83 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002540 Sep 28 15:36:33.944821 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:34.476226 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-b8e0802d-7c6f-4b9f-a514-491f4112267d admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:34.481613 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.wsgi [None req-b8e0802d-7c6f-4b9f-a514-491f4112267d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-b8e0802d-7c6f-4b9f-a514-491f4112267d admin admin] Request method failure captured: Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Accept: application/json Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Accept-Encoding: gzip, deflate Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Connection: keep-alive Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Content-Length: 0 Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Host: 10.222.0.60 Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Openstack-Api-Version: compute 2.92 Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Openstack-System-Scope: None Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: User-Agent: python-novaclient Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Auth-Token: gAAAAABjNGoBrrgeSWKsAJO_Ri6ROptdUmwmqE5adPiWlJAHKWHsgOBFeXPfX8xUPL4q4c4MUDa93JNLDz_bJ0YmHJkH6-RqMFafvw8nadDej89xajjGB0S1Ssb-87m78r_PrN8iXQIjngct-NSdqbX883YdH9VYFv0DpKTZIdNsHpz7dTtn1WE Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Domain-Id: None Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Domain-Name: None Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Identity-Status: Confirmed Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Is-Admin-Project: True Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Domain-Id: default Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Domain-Name: Default Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Name: admin Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Role: reader,member,admin Sep 28 15:36:34.484858 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Roles: reader,member,admin Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c663536db924b2aba9e9bb0e3254711"}]}] Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant: admin Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant-Name: admin Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User: admin Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Domain-Id: default Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Domain-Name: Default Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Id: a86c62b56d134029a7eefd7d39742f82 Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Name: admin Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: method: > Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: exception: Flavor 42 could not be found. Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: action_args: {'id': '42'} Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:36:34.486673 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:34.487852 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.489267 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-b8e0802d-7c6f-4b9f-a514-491f4112267d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:36:34.490616 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-b8e0802d-7c6f-4b9f-a514-491f4112267d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.403538 Sep 28 15:36:34.490616 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 28 15:36:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 15:36:34.496319 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-806d2873-1cc7-4da0-88b0-a6cdcd3fa5ba admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:34.519489 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-806d2873-1cc7-4da0-88b0-a6cdcd3fa5ba admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026987 Sep 28 15:36:34.519966 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 15:36:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:34.530615 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-552d94cb-f2ef-40d2-967e-f75ba18c28de admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:34.552847 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-552d94cb-f2ef-40d2-967e-f75ba18c28de admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026666 Sep 28 15:36:34.553651 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 15:36:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:36:34.563786 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-d2216ea0-0da1-4b96-a869-ede14bf29976 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:34.568979 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.wsgi [None req-d2216ea0-0da1-4b96-a869-ede14bf29976 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-d2216ea0-0da1-4b96-a869-ede14bf29976 admin admin] Request method failure captured: Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Accept: application/json Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Accept-Encoding: gzip, deflate Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Connection: keep-alive Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Content-Length: 0 Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Host: 10.222.0.60 Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Openstack-Api-Version: compute 2.92 Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Openstack-System-Scope: None Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: User-Agent: python-novaclient Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Auth-Token: gAAAAABjNGoBrrgeSWKsAJO_Ri6ROptdUmwmqE5adPiWlJAHKWHsgOBFeXPfX8xUPL4q4c4MUDa93JNLDz_bJ0YmHJkH6-RqMFafvw8nadDej89xajjGB0S1Ssb-87m78r_PrN8iXQIjngct-NSdqbX883YdH9VYFv0DpKTZIdNsHpz7dTtn1WE Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Domain-Id: None Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Domain-Name: None Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Identity-Status: Confirmed Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Is-Admin-Project: True Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Domain-Id: default Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Domain-Name: Default Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Name: admin Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Role: reader,member,admin Sep 28 15:36:34.572251 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Roles: reader,member,admin Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c663536db924b2aba9e9bb0e3254711"}]}] Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant: admin Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant-Name: admin Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User: admin Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Domain-Id: default Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Domain-Name: Default Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Id: a86c62b56d134029a7eefd7d39742f82 Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Name: admin Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: method: > Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: exception: Flavor 42 could not be found. Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: action_args: {'id': '42'} Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:36:34.573568 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:34.575684 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:34.577521 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-d2216ea0-0da1-4b96-a869-ede14bf29976 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111972) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:36:34.578783 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-d2216ea0-0da1-4b96-a869-ede14bf29976 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014213 Sep 28 15:36:34.578783 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 28 15:36:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 28 15:36:35.794103 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-552d94cb-f2ef-40d2-967e-f75ba18c28de admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:35.795648 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-552d94cb-f2ef-40d2-967e-f75ba18c28de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 28 15:36:35.796043 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:36.313083 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-2c34dce7-6ef6-40a5-9891-2de462a7eb36 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:36.318097 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.wsgi [None req-2c34dce7-6ef6-40a5-9891-2de462a7eb36 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-2c34dce7-6ef6-40a5-9891-2de462a7eb36 admin admin] Request method failure captured: Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Accept: application/json Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Accept-Encoding: gzip, deflate Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Connection: keep-alive Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Content-Length: 0 Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Host: 10.222.0.60 Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Openstack-Api-Version: compute 2.92 Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Openstack-System-Scope: None Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: User-Agent: python-novaclient Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Auth-Token: gAAAAABjNGoDkoGOoOt_z2pFj3Pa1eGaLfOSgueGGX6hPLexx1KqYcgI4Y4t0UgpsmnNJrBtBj4TWTFmeDbGZFlYRai7Y_AnyCmxQRZKI8OsP4NRESnruVKrsW-unACQavtlaSchm436qD95n9M3CwICEVDECBMOSD32MkdKvgC5xNYLQkDpUpI Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Domain-Id: None Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Domain-Name: None Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Identity-Status: Confirmed Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Is-Admin-Project: True Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Domain-Id: default Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Domain-Name: Default Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Name: admin Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Role: reader,member,admin Sep 28 15:36:36.319660 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Roles: reader,member,admin Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c663536db924b2aba9e9bb0e3254711"}]}] Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant: admin Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant-Name: admin Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User: admin Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Domain-Id: default Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Domain-Name: Default Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Id: a86c62b56d134029a7eefd7d39742f82 Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Name: admin Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: method: > Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: exception: Flavor 84 could not be found. Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: action_args: {'id': '84'} Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:36:36.321195 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:36.322135 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.323713 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-2c34dce7-6ef6-40a5-9891-2de462a7eb36 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111972) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:36:36.324930 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-2c34dce7-6ef6-40a5-9891-2de462a7eb36 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386334 Sep 28 15:36:36.324930 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 28 15:36:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 15:36:36.332300 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-f9fa629c-1caa-4408-ab39-146142e4f029 admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:36.349105 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-f9fa629c-1caa-4408-ab39-146142e4f029 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021220 Sep 28 15:36:36.349691 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 15:36:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:36.359432 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-06ec6fd4-043b-4943-969d-b2eec8c89b2e admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:36.374625 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-06ec6fd4-043b-4943-969d-b2eec8c89b2e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018805 Sep 28 15:36:36.375166 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 15:36:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:36.384381 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-f30a47dc-85a6-4112-b6f5-9a47b3282c5a admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:36.390273 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.wsgi [None req-f30a47dc-85a6-4112-b6f5-9a47b3282c5a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-f30a47dc-85a6-4112-b6f5-9a47b3282c5a admin admin] Request method failure captured: Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Accept: application/json Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Accept-Encoding: gzip, deflate Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Connection: keep-alive Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Content-Length: 0 Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Host: 10.222.0.60 Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Openstack-Api-Version: compute 2.92 Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Openstack-System-Scope: None Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: User-Agent: python-novaclient Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Auth-Token: gAAAAABjNGoDkoGOoOt_z2pFj3Pa1eGaLfOSgueGGX6hPLexx1KqYcgI4Y4t0UgpsmnNJrBtBj4TWTFmeDbGZFlYRai7Y_AnyCmxQRZKI8OsP4NRESnruVKrsW-unACQavtlaSchm436qD95n9M3CwICEVDECBMOSD32MkdKvgC5xNYLQkDpUpI Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Domain-Id: None Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Domain-Name: None Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Identity-Status: Confirmed Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Is-Admin-Project: True Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Domain-Id: default Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Domain-Name: Default Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Name: admin Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Role: reader,member,admin Sep 28 15:36:36.391826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Roles: reader,member,admin Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c663536db924b2aba9e9bb0e3254711"}]}] Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant: admin Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant-Name: admin Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User: admin Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Domain-Id: default Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Domain-Name: Default Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Id: a86c62b56d134029a7eefd7d39742f82 Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Name: admin Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: method: > Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: exception: Flavor 84 could not be found. Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: action_args: {'id': '84'} Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:36:36.393396 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:36.395377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:36.396711 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-f30a47dc-85a6-4112-b6f5-9a47b3282c5a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:36:36.397986 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-f30a47dc-85a6-4112-b6f5-9a47b3282c5a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012390 Sep 28 15:36:36.397986 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 28 15:36:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 28 15:36:37.611307 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-06ec6fd4-043b-4943-969d-b2eec8c89b2e admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:37.612336 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-06ec6fd4-043b-4943-969d-b2eec8c89b2e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 28 15:36:37.612735 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:36:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:38.138446 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-e9197c9d-3d9e-4b89-bd3b-447f9d23e954 admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:38.144702 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.wsgi [None req-e9197c9d-3d9e-4b89-bd3b-447f9d23e954 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-e9197c9d-3d9e-4b89-bd3b-447f9d23e954 admin admin] Request method failure captured: Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Accept: application/json Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Accept-Encoding: gzip, deflate Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Connection: keep-alive Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Content-Length: 0 Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Host: 10.222.0.60 Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Openstack-Api-Version: compute 2.92 Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Openstack-System-Scope: None Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: User-Agent: python-novaclient Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Auth-Token: gAAAAABjNGoFP-mH_XzrlWJtXcEkzGuXp4iGbhcfdV1E8U4FICX85HivwtZGyPmeoqOGLQu3UlNhx1rbZyPMxPz6yEOjogjCjJa-jumHmbSnVzKtl5kBFU9lpJMk8dqE1Otyb3UMXooNEqpIAlMxc2rdcCZaaLBCSjq71uPDgl4wG69U9qqnopQ Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Domain-Id: None Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Domain-Name: None Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Identity-Status: Confirmed Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Is-Admin-Project: True Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Domain-Id: default Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Domain-Name: Default Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Project-Name: admin Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Role: reader,member,admin Sep 28 15:36:38.146197 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Roles: reader,member,admin Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c663536db924b2aba9e9bb0e3254711"}]}] Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant: admin Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-Tenant-Name: admin Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User: admin Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Domain-Id: default Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Domain-Name: Default Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Id: a86c62b56d134029a7eefd7d39742f82 Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: X-User-Name: admin Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: method: > Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: exception: Flavor 451 could not be found. Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: action_args: {'id': '451'} Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:36:38.147826 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:38.148816 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.150170 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-e9197c9d-3d9e-4b89-bd3b-447f9d23e954 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:36:38.151451 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-e9197c9d-3d9e-4b89-bd3b-447f9d23e954 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398259 Sep 28 15:36:38.151451 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 15:36:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 15:36:38.158112 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-64247ebe-9456-4d8d-9e43-2af00f40d264 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:38.172880 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-64247ebe-9456-4d8d-9e43-2af00f40d264 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018956 Sep 28 15:36:38.173423 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 15:36:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:38.183035 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:38.198094 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018576 Sep 28 15:36:38.198660 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 28 15:36:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:38.208567 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-f8d76492-13c4-45ab-b51a-ffccc8810acf admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:38.213546 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.wsgi [None req-f8d76492-13c4-45ab-b51a-ffccc8810acf admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-f8d76492-13c4-45ab-b51a-ffccc8810acf admin admin] Request method failure captured: Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Accept: application/json Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Accept-Encoding: gzip, deflate Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Connection: keep-alive Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Content-Length: 0 Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Host: 10.222.0.60 Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Openstack-Api-Version: compute 2.92 Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Openstack-System-Scope: None Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: User-Agent: python-novaclient Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Auth-Token: gAAAAABjNGoFP-mH_XzrlWJtXcEkzGuXp4iGbhcfdV1E8U4FICX85HivwtZGyPmeoqOGLQu3UlNhx1rbZyPMxPz6yEOjogjCjJa-jumHmbSnVzKtl5kBFU9lpJMk8dqE1Otyb3UMXooNEqpIAlMxc2rdcCZaaLBCSjq71uPDgl4wG69U9qqnopQ Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Domain-Id: None Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Domain-Name: None Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Identity-Status: Confirmed Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Is-Admin-Project: True Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Domain-Id: default Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Domain-Name: Default Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Project-Name: admin Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Role: reader,member,admin Sep 28 15:36:38.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Roles: reader,member,admin Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c663536db924b2aba9e9bb0e3254711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c663536db924b2aba9e9bb0e3254711"}]}] Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant: admin Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant-Id: 4c663536db924b2aba9e9bb0e3254711 Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-Tenant-Name: admin Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User: admin Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Domain-Id: default Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Domain-Name: Default Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Id: a86c62b56d134029a7eefd7d39742f82 Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: X-User-Name: admin Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: method: > Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: exception: Flavor 451 could not be found. Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: action_args: {'id': '451'} Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:36:38.216941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:38.218043 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: ERROR nova.api.openstack.wsgi Sep 28 15:36:38.219368 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-f8d76492-13c4-45ab-b51a-ffccc8810acf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111972) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:36:38.220609 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-f8d76492-13c4-45ab-b51a-ffccc8810acf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011406 Sep 28 15:36:38.220609 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 15:36:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 28 15:36:39.444213 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:39.445223 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 28 15:36:39.445643 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:36:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:39.980891 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-0927a3db-33d5-4c8e-bf34-41276db3ca3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:40.000430 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-0927a3db-33d5-4c8e-bf34-41276db3ca3d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.417646 Sep 28 15:36:40.000968 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 28 15:36:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:36:41.228465 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:41.229469 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 28 15:36:41.229854 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:36:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:41.756694 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-e84bdaf8-bad3-4db3-b050-7831879caae7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:41.775077 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-e84bdaf8-bad3-4db3-b050-7831879caae7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401292 Sep 28 15:36:41.775625 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 28 15:36:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:36:43.009502 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:43.010534 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 28 15:36:43.010933 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:43.537941 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-611746e6-ddde-4747-9c93-e2b6763fe2fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:43.557117 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-611746e6-ddde-4747-9c93-e2b6763fe2fb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.407723 Sep 28 15:36:43.557742 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 28 15:36:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:36:44.764251 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:44.765263 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 Sep 28 15:36:44.765660 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:36:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:45.296992 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-ff00204c-7e05-4b0e-bb05-efad5b76a8eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:36:45.319146 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-ff00204c-7e05-4b0e-bb05-efad5b76a8eb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.415592 Sep 28 15:36:45.319889 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 28 15:36:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:36:46.545220 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:46.546230 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 28 15:36:46.546655 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:47.069275 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-3cab0087-8ed7-4405-9af1-8d89e2c2a732 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:47.089300 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-3cab0087-8ed7-4405-9af1-8d89e2c2a732 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403651 Sep 28 15:36:47.089834 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Sep 28 15:36:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:37:44.237024 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:37:44.238036 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-8f66cf8e-24cb-4939-8eb3-5d816fd6011a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 28 15:37:44.238456 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 28 15:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:37:44.249522 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:37:44.626608 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-fb18fbae-4765-4696-92a4-fec27294bc57 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:37:44.646882 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-fb18fbae-4765-4696-92a4-fec27294bc57 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402300 Sep 28 15:37:44.647423 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 28 15:37:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:37:44.668606 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writing DB stats nova_api:SELECT=14 {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:37:44.673146 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-04593408-e144-4acd-bd9c-5d2c7bb3e3fd admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:37:44.680788 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-04593408-e144-4acd-bd9c-5d2c7bb3e3fd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013397 Sep 28 15:37:44.681315 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Sep 28 15:37:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:37:44.693534 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-b91c3827-85c8-456c-9b3e-b26b75ada26e admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:37:44.700881 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-b91c3827-85c8-456c-9b3e-b26b75ada26e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010956 Sep 28 15:37:44.701404 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Sep 28 15:37:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:37:44.712694 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:37:44.719866 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010695 Sep 28 15:37:44.720377 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Sep 28 15:37:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:37:44.731591 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-ba4172f1-8e7d-4d11-a4e9-627b19c1782a admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:37:44.739268 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-ba4172f1-8e7d-4d11-a4e9-627b19c1782a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011163 Sep 28 15:37:44.739780 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Sep 28 15:37:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:40:44.439939 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:40:44.440998 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 28 15:40:44.441397 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:40:44.583954 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_api:SELECT=6 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:40:44.742333 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-8ed1bd68-1358-4b5e-9051-90a299a8af32 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:40:44.747086 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd68-1358-4b5e-9051-90a299a8af32 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:44.747590 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd68-1358-4b5e-9051-90a299a8af32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:44.748019 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd68-1358-4b5e-9051-90a299a8af32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:44.748728 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd68-1358-4b5e-9051-90a299a8af32 admin admin] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:44.749185 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd68-1358-4b5e-9051-90a299a8af32 admin admin] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:44.749600 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd68-1358-4b5e-9051-90a299a8af32 admin admin] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:44.781892 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-8ed1bd68-1358-4b5e-9051-90a299a8af32 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199097 Sep 28 15:40:44.782476 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 15:40:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:40:45.891432 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:40:45.892441 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 28 15:40:45.892838 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:40:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:40:46.081979 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-bdfeb594-1aac-43c0-b20c-1586090f48e9 admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:40:46.085477 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-bdfeb594-1aac-43c0-b20c-1586090f48e9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:46.085953 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-bdfeb594-1aac-43c0-b20c-1586090f48e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:46.086438 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-bdfeb594-1aac-43c0-b20c-1586090f48e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:46.087185 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-bdfeb594-1aac-43c0-b20c-1586090f48e9 admin admin] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:46.087591 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-bdfeb594-1aac-43c0-b20c-1586090f48e9 admin admin] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:46.088067 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-bdfeb594-1aac-43c0-b20c-1586090f48e9 admin admin] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:46.107458 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-bdfeb594-1aac-43c0-b20c-1586090f48e9 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076080 Sep 28 15:40:46.107933 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 15:40:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:40:57.593093 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:40:57.594097 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Sep 28 15:40:57.594650 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:40:57.739962 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_cell0:SELECT=4 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:40:57.740686 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_cell1:SELECT=4 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:40:57.741336 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG dbcounter [-] [111972] Writing DB stats nova_api:SELECT=8 {{(pid=111972) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:40:57.793001 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-8480ccaa-4ddc-483b-a8c7-82c2e2cc72af admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:40:57.797016 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8480ccaa-4ddc-483b-a8c7-82c2e2cc72af admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:57.797497 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8480ccaa-4ddc-483b-a8c7-82c2e2cc72af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:57.797927 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8480ccaa-4ddc-483b-a8c7-82c2e2cc72af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:57.798719 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8480ccaa-4ddc-483b-a8c7-82c2e2cc72af admin admin] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:57.799129 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8480ccaa-4ddc-483b-a8c7-82c2e2cc72af admin admin] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:57.799548 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-8480ccaa-4ddc-483b-a8c7-82c2e2cc72af admin admin] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:57.824735 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-8480ccaa-4ddc-483b-a8c7-82c2e2cc72af admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.089135 Sep 28 15:40:57.825303 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 15:40:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:40:58.934658 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG nova.api.openstack.wsgi [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] Calling method '>' {{(pid=111971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:40:58.935755 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: INFO nova.api.openstack.requestlog [None req-89fd6087-b50c-43c1-9b05-3a721f5d7d1d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Sep 28 15:40:58.936159 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: [pid: 111971|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 28 15:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:40:59.130817 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG nova.api.openstack.wsgi [None req-11824aa5-f225-4faf-8402-e94651d6157c admin admin] Calling method '>' {{(pid=111972) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:40:59.134127 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-11824aa5-f225-4faf-8402-e94651d6157c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:59.134640 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-11824aa5-f225-4faf-8402-e94651d6157c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:59.135094 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-11824aa5-f225-4faf-8402-e94651d6157c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:59.135805 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-11824aa5-f225-4faf-8402-e94651d6157c admin admin] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:59.136302 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-11824aa5-f225-4faf-8402-e94651d6157c admin admin] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:59.136673 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: DEBUG oslo_concurrency.lockutils [None req-11824aa5-f225-4faf-8402-e94651d6157c admin admin] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111972) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:59.158702 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: INFO nova.api.openstack.requestlog [None req-11824aa5-f225-4faf-8402-e94651d6157c admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080024 Sep 28 15:40:59.159260 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: [pid: 111972|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 28 15:40:59 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:41:58.298397 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: Wed Sep 28 15:41:58 2022 - graceful shutdown triggered... Sep 28 15:41:58.297892 dv-cinder-859316-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 28 15:41:58.299387 dv-cinder-859316-1-iscsi devstack@n-api.service[111972]: Gracefully killing worker 2 (pid: 111972)... Sep 28 15:41:58.299754 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: Gracefully killing worker 1 (pid: 111971)... Sep 28 15:41:58.425750 dv-cinder-859316-1-iscsi devstack@n-api.service[111971]: DEBUG dbcounter [-] [111971] Writing DB stats nova_api:SELECT=4 {{(pid=111971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:59.298954 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: worker 1 buried after 1 seconds Sep 28 15:41:59.298954 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: worker 2 buried after 1 seconds Sep 28 15:41:59.298954 dv-cinder-859316-1-iscsi devstack@n-api.service[111970]: goodbye to uWSGI. Sep 28 15:41:59.300655 dv-cinder-859316-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 28 15:41:59.301233 dv-cinder-859316-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 28 15:41:59.304124 dv-cinder-859316-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 15:41:59.315239 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 15:41:59.317264 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 15:41:59 2022] *** Sep 28 15:41:59.317428 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 15:41:59.317544 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 15:41:59.317668 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: nodename: dv-cinder-859316-1-iscsi Sep 28 15:41:59.317797 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: machine: x86_64 Sep 28 15:41:59.317912 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: clock source: unix Sep 28 15:41:59.318045 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: pcre jit disabled Sep 28 15:41:59.318045 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: detected number of CPU cores: 4 Sep 28 15:41:59.318045 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: current working directory: / Sep 28 15:41:59.318045 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: detected binary path: /usr/bin/uwsgi-core Sep 28 15:41:59.318045 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: your processes number limit is 47680 Sep 28 15:41:59.318045 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: your memory page size is 4096 bytes Sep 28 15:41:59.318045 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: detected max file descriptor number: 2048 Sep 28 15:41:59.318045 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: lock engine: pthread robust mutexes Sep 28 15:41:59.318630 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: thunder lock: enabled Sep 28 15:41:59.318630 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 15:41:59.318630 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 15:41:59.358894 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: Python main interpreter initialized at 0x557d546f09c0 Sep 28 15:41:59.358894 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: python threads support enabled Sep 28 15:41:59.358894 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: your server socket listen backlog is limited to 100 connections Sep 28 15:41:59.358894 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: your mercy for graceful operations on workers is 90 seconds Sep 28 15:41:59.359374 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 15:41:59.359374 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: *** Operational MODE: preforking *** Sep 28 15:41:59.359628 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: *** uWSGI is running in multiple interpreter mode *** Sep 28 15:41:59.359628 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: spawned uWSGI master process (pid: 126980) Sep 28 15:41:59.359844 dv-cinder-859316-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 15:41:59.360713 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: spawned uWSGI worker 1 (pid: 126996, cores: 1) Sep 28 15:41:59.361070 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: spawned uWSGI worker 2 (pid: 126997, cores: 1) Sep 28 15:41:59.361243 dv-cinder-859316-1-iscsi devstack@n-api.service[126980]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 15:42:00.038345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 15:42:00.041499 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 15:42:01.210546 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:42:01.210546 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: from cryptography.utils import int_from_bytes Sep 28 15:42:01.211216 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:42:01.211216 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: from cryptography.utils import int_from_bytes Sep 28 15:42:01.226137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:42:01.226137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: from cryptography.utils import int_from_bytes Sep 28 15:42:01.226730 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:42:01.226730 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: from cryptography.utils import int_from_bytes Sep 28 15:42:03.623472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 15:42:03.624039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 15:42:03.624326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 15:42:03.624559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 15:42:03.624815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 15:42:03.625213 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.626128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.626472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.626802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.627139 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.627452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.627777 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.628095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.628424 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.628685 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.628998 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.629520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859316-1-iscsi {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.629837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.630149 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.630487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.630819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.631131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.631457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.631781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.632291 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.633697 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.633697 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.633697 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.633980 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.634298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.634638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.634964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.635286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.635611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.635985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.636417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859316-1-iscsi {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.636731 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.637052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.637371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.637808 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.638114 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.638472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.638796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.639120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.639438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.639762 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.640084 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.640423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.640729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.641137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.641629 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.642471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.642471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.642656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.642904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.643159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.643470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.643805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.644118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.644445 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.644698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.644947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.645269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.645586 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.645896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.646207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.646568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.646918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.647240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.647544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.647852 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.648161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.648483 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.648800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.649130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.649437 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.649757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.650170 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.650445 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.650755 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.651100 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.651422 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.651733 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.652056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.652380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.652691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.652997 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.653308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.653630 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.653972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.654281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.654578 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.654883 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.655195 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.655517 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.655826 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.656135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.656445 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.656785 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.657097 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.657405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.657714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.658023 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.658332 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.658669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.658974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.659289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.659593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.659899 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.660219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.660542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.660853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.661161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.661469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.661779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.662107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.662429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.662738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.662833 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 15:42:03.663234 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 15:42:03.663325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.663425 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.663627 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 15:42:03.663734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.663911 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 15:42:03.664019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.664176 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 15:42:03.664268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.664542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.664641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.664860 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.664957 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.665161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.665274 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.665469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.665565 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.665788 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.665892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.666096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.666211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.666403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.666570 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.666759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.666856 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.667020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.667207 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.667353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.667523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.667674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.667825 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.668005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.668153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859316-1-iscsi {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.668295 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.668445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.668586 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.668753 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.668907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.669049 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.669202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.669349 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.669497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.669643 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.669793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.669943 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.670083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.670239 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.670387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.670663 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.670912 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.671107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.671259 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.671411 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.671559 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.671713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.671864 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.672014 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.672674 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.672824 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.672973 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.673133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.673284 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.673447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.673595 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.673736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.673889 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.674038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.674179 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.674327 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.674529 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.674684 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.674856 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.674998 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859316-1-iscsi {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.675148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.675959 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.676144 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.676297 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.676297 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.676574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.676574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.676903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.677047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.677196 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.677345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.677485 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.677627 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.677775 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.677939 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.678080 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.678228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.678369 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.678534 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.678677 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.678849 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.679518 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.679672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.679815 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.679957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.680099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.680257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.680410 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.680551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.680711 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.680711 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.681176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.681176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.681457 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.681609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.681765 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.681765 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.682055 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.682197 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.682337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.682540 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.682694 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.682836 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.682986 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.683137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.683288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.683429 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.683820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.683966 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.684116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.684258 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.684401 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.684558 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.684708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.684857 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.685007 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.685148 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.685288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.685427 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.686144 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.686314 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.686499 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.686750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.686944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.687110 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.687343 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.687499 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.687689 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.687892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.688644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.688787 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.688938 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.689089 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.689230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.689371 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.689512 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.689651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.689889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.690033 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.690183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.690324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.690523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.690682 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.690838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.691075 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.691322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.691470 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.691612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.691762 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.691917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.692076 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.692224 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.692373 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.692522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.692672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.692820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.692961 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.693102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.693253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.693395 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.693548 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.693699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.693851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.693999 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.694140 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.694289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.694459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.694619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.694759 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.694899 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.695040 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.695186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.695336 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.695485 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.695627 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.696185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.696421 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.696584 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.696752 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.697025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.697183 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.697339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.697491 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.697633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.697782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.697935 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.698078 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.698226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.698386 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.698574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.698730 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.698879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.699027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.699169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.699319 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.699468 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.699630 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.699780 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.699921 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.700062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.700062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.700353 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.700509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.700651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.700791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.700930 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.701096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.701337 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.701568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.701719 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.701866 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.702014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.702156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.702318 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.702491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.702640 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.702796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.702938 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.703085 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.703244 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.703386 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.703589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.703745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.703894 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.704036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.704036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.704329 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.704481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.704634 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.704776 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.704925 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.705074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.705222 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.705363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.705516 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.705657 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.705797 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.706353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.706638 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.706800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.707097 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.707264 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.707414 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.707556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.707704 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.707860 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.708004 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.708004 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.708270 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.708410 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.708551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.708699 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.708858 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.709008 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.709151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.709301 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.709449 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.709599 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.709741 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.709888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.710043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.710191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.710507 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.710663 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.710822 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.710964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.711105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.711259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.711509 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.711763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.711911 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.712054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.712204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:42:03.712359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.712501 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.712650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.712809 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.712951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.713091 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.713257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.713406 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.713547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.713695 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.713845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.713997 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.714148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.714298 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.714482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.714631 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.714783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.714933 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.715075 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.715223 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.715366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.715514 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.715654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.715804 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.715953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.716493 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.716669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.716907 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.717119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.717119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.718195 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.718344 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.718521 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.718675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.718817 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.718972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.719163 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.719309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.719449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.719591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.719749 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.719911 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.720060 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.720203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.720379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.720522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.720678 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.720827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.720975 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.721116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.721256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.721396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.721648 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.721892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.722060 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.722211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.722352 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.722577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.722732 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.722874 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.723016 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.723163 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.723307 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.723456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.723598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.723740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.723888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.724047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.724197 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.724352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.724499 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.724748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.724905 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.725053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.725201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.725361 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.725503 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.725650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.725791 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.725939 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.726089 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.726645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.726798 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.726966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.727248 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.727399 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.727550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.727698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.727847 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.728104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.728253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.728401 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.728562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.728705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.728846 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.728987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.729256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.729498 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.729657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.729800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.729949 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.730098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.730246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.730395 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.730632 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.730791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.730931 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.731073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.731232 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.731507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.731681 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.731908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.732142 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.732290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.732431 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.732580 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.732721 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.732862 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.733012 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.733173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.733324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.733474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.733615 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.733763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.733904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.734052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.734201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.734352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.734529 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.735189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.735348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.735509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.735658 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.735812 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.735953 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.736092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.736240 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.736744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.736912 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.737064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.737326 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.737478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.737624 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.737760 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.737921 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738175 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738261 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738344 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738443 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738543 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738629 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738719 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738804 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.738970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.739062 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.739062 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.739515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.739622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.739708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.739801 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.739888 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.739972 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740156 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740337 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740432 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740525 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740879 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.740962 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741045 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741136 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741229 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741568 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741935 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741935 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.741935 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.742186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.742271 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.742359 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.742459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.742459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.742459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.742705 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.743415 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.743415 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.743415 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.743712 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.743850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.743850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.743850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744404 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744573 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744757 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744849 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.744849 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745023 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745264 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745525 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745700 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745822 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.745981 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.746240 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.746332 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.746645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.746944 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.747050 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.747211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.747371 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.747547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.747731 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.747833 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.748114 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.748221 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.748423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.748667 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.748758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.749024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.749181 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.749330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.749619 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.749743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.749938 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.750086 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.750249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.751162 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.751315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.751453 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.751619 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.751769 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.752018 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.752153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.752330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.752571 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.752717 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.752979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.753144 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.753306 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.753517 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.753654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.753826 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.754020 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.754159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.754606 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.754779 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.754917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.755074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.755233 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.755385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.755631 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.755784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.755970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.756144 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.756301 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.756568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.756852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.757135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.757294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.757465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.757634 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.757859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.757859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.758121 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.758277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.758450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.758587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.758734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.758969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.759274 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.759410 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.759581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.759825 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.759964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.760179 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.760315 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.760481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.760736 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.760882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.761073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.761225 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.761394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.761672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.761823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.761993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.762207 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.762357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.762610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.762758 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.762957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.763184 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.763330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.763571 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.763715 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.763904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.764077 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.764227 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.764521 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.764816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.764816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.765113 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.765258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.765435 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.766094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.766243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.766397 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.766756 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.767236 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.767392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.767392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.767701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.767839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.768093 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.768243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.768394 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.768554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.768554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.768823 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.768973 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.768973 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.769244 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.769380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.769380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.769659 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.769809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.770058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.770207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.770207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.770528 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.770681 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.770681 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.770960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.771097 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.771233 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.771369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.771546 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.771696 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.771859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.772144 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.772282 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.772468 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.772646 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.772784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.773059 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.773287 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.773447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.773601 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.773745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.773973 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.774109 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.774284 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.774505 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.774666 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.774976 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.775126 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.775276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.775426 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.775562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.775794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.775930 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.776242 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.776380 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.776558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.776800 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.776937 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.777247 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.777576 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.777716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.777865 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.778022 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.778258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.778397 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.778568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.778705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.778838 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.779089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.779236 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.779408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.779617 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.779774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.780026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.780261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.780400 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.780558 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.780714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.780931 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.781162 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.781314 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.781469 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.781626 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.781908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.782043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.782211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.782462 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.782606 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.782844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.782979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.783169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.783402 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.783590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.783842 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.783979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.784199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.784366 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.784618 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.784789 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.784940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.785218 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.785357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.785542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.785715 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.785853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.786171 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.786397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.786561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.786711 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.786862 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.787103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.787519 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.787710 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.787855 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.788005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.788142 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.788289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.788452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.788660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.788811 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.788961 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.789097 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.789246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.789475 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.789622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.789869 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.790008 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.790341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.790551 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.790704 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.790842 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.791003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.791660 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.791820 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.791961 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.792111 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.792249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.792397 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.792557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.792557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.792816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.793629 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.793787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.793927 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.794077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.794077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.794358 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.794509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.794509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.795047 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.795341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.795487 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.795639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.795639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.795932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.796079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.796216 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.796364 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.796364 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.796660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.796817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.796954 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.797089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.798092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.798241 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.798378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.798568 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.798828 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.798828 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.799101 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.799249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.799386 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.799546 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.799682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.799828 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.799978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.800188 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.800337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.800600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.800845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.801180 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.801428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.801565 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.801816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.801953 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.802147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.802379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.802544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.802790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.802946 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.803112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.803327 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.803465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.803734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.803887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.804043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.804247 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.804408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.804631 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.804775 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.804922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.805395 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.805561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.805561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.805817 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.805953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.806109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.806258 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.806394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.806815 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.806979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.807117 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.807270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.807417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.807556 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.807693 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.808321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.808476 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.808897 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.808990 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.809074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.809158 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.809545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.809808 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.809910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.810172 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.810310 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.810526 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.810816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.810923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.811154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.811342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.811474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.811795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.811894 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.812113 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.812305 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.812432 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.812743 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.812859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.813599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.813843 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.813948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.814222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.814312 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.814561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.814776 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.815144 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.815245 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.815481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.815650 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.815797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.816094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.816196 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.816411 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.816582 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.816729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.817028 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.817133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.817341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.817527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.817653 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.817969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.818079 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.818397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.818517 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.818638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.818906 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.818997 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.819272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.819419 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.819613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.819844 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.819944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.820243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.820348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.820566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.820771 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.820870 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.821206 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.821306 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.821531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.821700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.821839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.822141 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.822251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.822478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.822657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.822795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.823090 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.823201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.823410 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.823584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.823724 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.824019 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.824131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.824337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.824524 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.824647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.824953 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.825052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.825264 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.825454 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.825588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.825891 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.825991 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.826228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.826388 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.826568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.826846 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.826947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.827183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.827334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.827706 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.827806 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.828019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.828220 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829044 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829199 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829403 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829640 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829731 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.829948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.830073 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.830258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.830527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.830634 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.830967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.831069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832121 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832302 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832497 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.832810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.833001 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.833123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.833479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.833664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.834019 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.834123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.834318 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.834537 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.834672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.835029 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.835183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.835440 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.835584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.835751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.836076 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.836191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.836377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.836596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.836704 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.836987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.837079 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.837297 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.837511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.837602 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.837897 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.838018 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.838210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.839334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.839475 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.839564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.839663 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.839749 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.839842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.839939 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.840031 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.840031 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.840031 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.840274 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.840359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.840655 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.840755 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.841040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.841198 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.841348 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.841637 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.841735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.841950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.842146 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.842245 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.842580 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.842686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.842888 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.843110 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.843302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.843558 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.843656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.843909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.844595 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.844789 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.844924 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.845102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.845252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.845409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.845578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.845736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.845899 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.846043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.846212 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.846349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.846544 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.846695 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.846877 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.847001 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.847196 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.847325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.847511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.847640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.847840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.847955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.848168 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.848303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.848507 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.848622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.848802 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.849114 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.849213 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.849430 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.849532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.849743 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.849897 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.850074 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.850187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.850374 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.850595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.850715 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.850808 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.851032 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.851123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.851345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.851449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.851660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.851751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.851972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.852070 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.852280 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.852378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.852591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.852688 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.852901 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.852991 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.853210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.853301 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.853523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.853613 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.853834 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.853925 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.854142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.854232 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.854471 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.854566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.854783 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.854887 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.855090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.855186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.855395 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.855493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.855703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.855843 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.856015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.856160 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.856331 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.856475 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.856672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.856773 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.856992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.857083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.857309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.857407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.857625 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.857792 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.857944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.858043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.858253 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.858353 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.858591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.858729 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.858926 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.859052 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.859210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.859320 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.859524 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.859617 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.860403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.860516 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.860721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.860820 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.861037 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.861129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.861425 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.861515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.861734 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.861833 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.862040 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.862133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.862346 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.862476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.862702 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.862807 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.863029 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.863120 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.863353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.863444 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.863667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.863778 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.863989 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.864302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.864403 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.864615 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.864713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.864965 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.865067 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.865293 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.865385 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.865619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.865788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.865927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.866027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.866234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.866327 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.866559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.866671 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.866870 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.866970 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.867190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.867288 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.867502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.867601 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.867807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.867899 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.868112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.868203 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.868423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.868527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.868732 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.868848 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.869038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.869139 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.869341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.869471 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.869645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.869753 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.869953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.870044 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.870255 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.870356 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.870579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.870715 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.870882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.871043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.871191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.871357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.871495 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.871681 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.871799 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.872009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.872113 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.872320 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.872420 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.872629 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.872727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.872944 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.873047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.873251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.873345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.873592 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.873698 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.873875 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.873967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.874262 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.874368 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.874509 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.874596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.874826 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.874947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.875136 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.875226 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.875488 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.875594 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.875799 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.875892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.876121 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.876211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.876426 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.876527 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.876741 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.876840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.877052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.877151 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.877374 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.877474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.877684 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.877774 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.877990 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.878088 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.878301 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.878400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.878634 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.878738 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.878939 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.879030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.879251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.879375 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.879554 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.879655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.879901 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.880018 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.880206 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.880307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.880965 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881095 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881285 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881472 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881565 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881768 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.881869 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.882099 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.882192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.882442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.882537 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.882745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.882851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.883057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.883156 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.883370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.883474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.883676 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.883784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.883983 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.884074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.884292 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.884383 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.884595 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.884699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.884901 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.885000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.885209 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.885300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.885526 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.885617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.885830 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.885912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.886135 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.886224 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.886467 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.886554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.886794 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.886877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.887099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.887194 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.887424 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.887514 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.887733 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.887828 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.888039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.888122 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.888346 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.888447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.888652 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.888744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.888997 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.889097 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.889250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 15:42:03.889347 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.889624 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.889937 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.890265 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.890681 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.890975 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.891302 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.891621 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.891942 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.892260 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.892582 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.892888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.893204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.893519 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.893834 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.894403 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.894757 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.895076 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.895395 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.895714 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.896031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.896349 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.896664 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.896978 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.897290 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.897607 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.897940 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.898253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.898607 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.899007 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.899271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.899588 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.899906 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.900224 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.900582 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.900902 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.901211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.901528 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.901845 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.902160 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.902493 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.902810 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.903128 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.903442 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.903754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.904065 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.904380 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.904693 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.905019 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.905355 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.905682 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.905997 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.906311 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.907183 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.907712 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.908044 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.908378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.908710 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.909036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.909357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.909679 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.910012 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.910323 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.910657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.910973 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.911285 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.911592 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.911919 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.912257 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.912564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.912884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.913196 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.913736 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.914084 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.914402 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.914751 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.915078 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.915394 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.915709 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.916035 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.916343 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.916651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.916966 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.917276 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.917581 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.917886 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.918197 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.918527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.918833 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.919145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.919449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.919775 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.920082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.920388 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.920695 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.921011 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.921319 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.921628 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.921935 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.922829 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.923156 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.923463 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.923874 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.924182 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.924497 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.924851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.925164 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.925494 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.925801 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.926109 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.926442 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.926751 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.927065 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.927389 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.927705 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.928019 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.928371 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.928687 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.929231 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.929569 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.929890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.930233 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.930600 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.930913 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.931218 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.931527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.931853 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.932162 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.932477 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.932788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.933107 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.933416 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.934080 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.934324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.934656 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.934971 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.935282 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.935599 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.935910 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.936221 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.936531 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.936847 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.937189 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.937510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.937880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.938201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.938542 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.938854 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.939164 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.939494 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.939786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.940102 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.940438 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.940753 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.941062 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.941517 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.941852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.942250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.942597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.942909 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.943240 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.943562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.943878 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.944204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.944512 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.944843 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.945185 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.945518 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.945842 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.946150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.946474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.946782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.947090 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.947409 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.947718 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.948020 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.948324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.948755 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.948938 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.949241 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.949544 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.949858 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.950153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.950473 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.950779 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.951083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.951384 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.951491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO dbcounter [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Registered counter for database nova_api Sep 28 15:42:03.951685 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.951988 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.952293 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.952594 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.952897 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.953197 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.953546 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.953850 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.954181 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.954534 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.954852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.955175 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.955491 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.955813 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.956122 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.956443 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.956765 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.957081 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.957390 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.957722 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.958065 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.958349 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.958690 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.958998 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.959309 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.959617 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.959947 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.960276 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.960583 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.960908 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.961229 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.961548 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.961866 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.962181 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.962535 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.962852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.963166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.963475 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.963793 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.964106 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.964423 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.964734 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.965047 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.965364 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.965684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.966014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.967256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.967256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.967256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.967639 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.967639 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.967942 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.968288 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.968627 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.968940 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.969825 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.970125 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:42:03.970369 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 15:42:03.972166 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_db.sqlalchemy.engines [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:42:03.978793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writer thread running {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:42:04.032611 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO dbcounter [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Registered counter for database nova_api Sep 28 15:42:04.035042 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.context [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87116ee1-0fc8-49a7-9503-1c7e788a9bed(cell1) {{(pid=126996) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 15:42:04.039039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.039508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.041054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.041790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.042294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.044280 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.046252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO dbcounter [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Registered counter for database nova_cell0 Sep 28 15:42:04.051025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO dbcounter [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Registered counter for database nova_cell1 Sep 28 15:42:04.053158 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_db.sqlalchemy.engines [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:42:04.058466 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_db.sqlalchemy.engines [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:42:04.060440 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writer thread running {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:42:04.060924 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_db.sqlalchemy.engines [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:42:04.065607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writer thread running {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:42:04.071346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writer thread running {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:42:04.117794 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.context [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87116ee1-0fc8-49a7-9503-1c7e788a9bed(cell1) {{(pid=126997) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 15:42:04.121835 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.122302 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.123942 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.124620 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.125061 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.127830 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.129829 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO dbcounter [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Registered counter for database nova_cell0 Sep 28 15:42:04.133875 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO dbcounter [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Registered counter for database nova_cell1 Sep 28 15:42:04.142275 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_db.sqlalchemy.engines [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:42:04.144530 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_db.sqlalchemy.engines [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:42:04.148779 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writer thread running {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:42:04.215705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO dbcounter [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Registered counter for database nova_cell0 Sep 28 15:42:04.223466 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_db.sqlalchemy.engines [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:42:04.228540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writer thread running {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:42:04.288189 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writer thread running {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:42:04.299284 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO dbcounter [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Registered counter for database nova_cell0 Sep 28 15:42:04.306228 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_db.sqlalchemy.engines [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:42:04.312101 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writer thread running {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:42:04.567129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: WARNING keystonemiddleware.auth_token [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:42:04.574497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: WARNING keystonemiddleware.auth_token [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:42:04.632925 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: WARNING keystonemiddleware.auth_token [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:42:04.640652 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: WARNING keystonemiddleware.auth_token [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:42:04.929200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: WARNING keystonemiddleware.auth_token [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:42:04.935151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: WARNING keystonemiddleware.auth_token [None req-57ff502b-57f0-473d-a2d1-ff385da315bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:42:04.941215 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557d546f09c0 pid: 126996 (default app) Sep 28 15:42:04.990681 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: WARNING keystonemiddleware.auth_token [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:42:04.996672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: WARNING keystonemiddleware.auth_token [None req-12330b00-679b-436f-a840-1ac9a29c883c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:42:05.002603 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557d546f09c0 pid: 126997 (default app) Sep 28 15:42:40.608308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:40.609211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:40.610167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:40.611175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:40.684500 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:40.685902 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:40.686717 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:40.687674 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:41.818366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-41e36c02-8a31-4a60-8e58-6e593d6b1ebb tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Action: 'create', calling method: .version_select at 0x7f8fd0b954c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1740223517"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:41.911625 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7e18d247-28b4-4e94-ac7a-adaaaca1711a tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Action: 'create', calling method: .version_select at 0x7f8fd0b954c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1904186649", "metadata": {"Type": "work"}}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:44.323720 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7e18d247-28b4-4e94-ac7a-adaaaca1711a tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.648136 Sep 28 15:42:44.337383 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 28 15:42:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3664 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 15:42:44.444829 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-41e36c02-8a31-4a60-8e58-6e593d6b1ebb tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.853364 Sep 28 15:42:44.446641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 1/2] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Sep 28 15:42:40 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3857 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 15:42:44.462796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4e556388-f2c8-4244-9e4c-f6367dbe1999 tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Calling method '.version_select at 0x7f8fd0a653a0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:44.641764 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4e556388-f2c8-4244-9e4c-f6367dbe1999 tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16" status: 200 len: 353 microversion: 2.1 time: 0.193193 Sep 28 15:42:44.644346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:44 2022] GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16 => generated 353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:44.658636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-00cb413a-8c79-412c-9b35-c40ee5dcbe88 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a65af0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:44.685859 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dd56161a-b6ec-4b22-b310-434a414f34c1 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Action: 'create', calling method: .version_select at 0x7f8fd0a68310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1937601600", "metadata": {"Type": "work"}}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dd56161a-b6ec-4b22-b310-434a414f34c1 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Request method failure captured: Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 122 Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGtxBSM-OQZf6FU8A2S-f4Pm-SXubatNBL4nWDgm2S2gRKa31faRLYef0bmeMVwzQpEy9ycSNmUyiIhjvASFMHUWmdiDPH5_hoBa28FOAFsh5v3t526ImtRmMjIvslASXVfkNt8trxRnf3e8ZZhzio6x_GMmMy1IgFrymZAeVsOkWjk Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:42:44.706510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03e570df30ec409bae5b536144353a81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03e570df30ec409bae5b536144353a81"}]}] Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 1c7906d5da9444dc86c4cd7904d54dc0 Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1937601600", "metadata": {"Type": "work"}}} Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: Sep 28 15:42:44.707993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1937601600', 'metadata': {'Type': 'work'}}}} Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise error Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi '#$%' Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:44.708887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 15:42:44.710333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 15:42:44.712383 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 15:42:44.712383 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.719663 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dd56161a-b6ec-4b22-b310-434a414f34c1 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:44.723288 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dd56161a-b6ec-4b22-b310-434a414f34c1 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.384050 Sep 28 15:42:44.724569 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 2/4] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 28 15:42:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 386 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:42:44.743991 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-68026b24-2818-4d78-879b-a6ebaa31c963 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Action: 'create', calling method: .version_select at 0x7f8fd0a7adc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2073319066", "metadata": {"Type": "work"}}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-68026b24-2818-4d78-879b-a6ebaa31c963 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Request method failure captured: Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 120 Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGtxBSM-OQZf6FU8A2S-f4Pm-SXubatNBL4nWDgm2S2gRKa31faRLYef0bmeMVwzQpEy9ycSNmUyiIhjvASFMHUWmdiDPH5_hoBa28FOAFsh5v3t526ImtRmMjIvslASXVfkNt8trxRnf3e8ZZhzio6x_GMmMy1IgFrymZAeVsOkWjk Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:42:44.756684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03e570df30ec409bae5b536144353a81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03e570df30ec409bae5b536144353a81"}]}] Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 1c7906d5da9444dc86c4cd7904d54dc0 Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2073319066", "metadata": {"Type": "work"}}} Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: Sep 28 15:42:44.758744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2073319066', 'metadata': {'Type': 'work'}}}} Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise error Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi '0' Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:44.759932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 15:42:44.761204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 15:42:44.762377 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 15:42:44.762377 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.765528 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-68026b24-2818-4d78-879b-a6ebaa31c963 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:44.766215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-68026b24-2818-4d78-879b-a6ebaa31c963 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.035257 Sep 28 15:42:44.768077 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 3/5] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 28 15:42:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:42:44.786531 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-30a41b7a-9d7a-4665-a820-01d70dfa8525 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Action: 'create', calling method: .version_select at 0x7f8fd0a68790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1569379569", "metadata": {"Type": "work"}}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-30a41b7a-9d7a-4665-a820-01d70dfa8525 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Request method failure captured: Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 119 Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGtxBSM-OQZf6FU8A2S-f4Pm-SXubatNBL4nWDgm2S2gRKa31faRLYef0bmeMVwzQpEy9ycSNmUyiIhjvASFMHUWmdiDPH5_hoBa28FOAFsh5v3t526ImtRmMjIvslASXVfkNt8trxRnf3e8ZZhzio6x_GMmMy1IgFrymZAeVsOkWjk Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:42:44.802050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03e570df30ec409bae5b536144353a81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03e570df30ec409bae5b536144353a81"}]}] Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 1c7906d5da9444dc86c4cd7904d54dc0 Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1569379569", "metadata": {"Type": "work"}}} Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: Sep 28 15:42:44.803407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1569379569', 'metadata': {'Type': 'work'}}}} Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise error Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi '' Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:44.804186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 15:42:44.806283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 15:42:44.809094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 15:42:44.809094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.809094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-30a41b7a-9d7a-4665-a820-01d70dfa8525 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:44.809094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-30a41b7a-9d7a-4665-a820-01d70dfa8525 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028781 Sep 28 15:42:44.813870 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 4/6] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 28 15:42:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:42:44.815531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-00cb413a-8c79-412c-9b35-c40ee5dcbe88 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe" status: 200 len: 345 microversion: 2.1 time: 0.167474 Sep 28 15:42:44.824772 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:44 2022] GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe => generated 345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:44.831164 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f830a625-436b-461b-a3f7-7cd26fe6820a tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Calling method '.version_select at 0x7f8fd0a3af70>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:44.885309 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-f830a625-436b-461b-a3f7-7cd26fe6820a tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] HTTP exception thrown: Volume tempest-invalid-1308115983 could not be found. Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f830a625-436b-461b-a3f7-7cd26fe6820a tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Request method failure captured: Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1308115983 HTTP/1.1 Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGtxBSM-OQZf6FU8A2S-f4Pm-SXubatNBL4nWDgm2S2gRKa31faRLYef0bmeMVwzQpEy9ycSNmUyiIhjvASFMHUWmdiDPH5_hoBa28FOAFsh5v3t526ImtRmMjIvslASXVfkNt8trxRnf3e8ZZhzio6x_GMmMy1IgFrymZAeVsOkWjk Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:42:44.890479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03e570df30ec409bae5b536144353a81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03e570df30ec409bae5b536144353a81"}]}] Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 1c7906d5da9444dc86c4cd7904d54dc0 Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Volume tempest-invalid-1308115983 could not be found. Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'id': 'tempest-invalid-1308115983'} Sep 28 15:42:44.892246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1308115983 could not be found. (HTTP 404) (Request-ID: req-4b28e484-e29c-4f74-96f0-eed2ccf49277) Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.893167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:42:44.894400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1308115983 could not be found. Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:44.895591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1308115983 could not be found. Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1308115983 could not be found. Sep 28 15:42:44.896750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:44.899677 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f830a625-436b-461b-a3f7-7cd26fe6820a tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Returning 404 to user: Volume tempest-invalid-1308115983 could not be found. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:44.900917 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f830a625-436b-461b-a3f7-7cd26fe6820a tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1308115983" status: 404 len: 99 microversion: 2.1 time: 0.086012 Sep 28 15:42:44.901727 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 28 15:42:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1308115983 => generated 99 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 28 15:42:44.915240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9d7084e6-6641-44d1-9920-99b839d676a9 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006768 Sep 28 15:42:44.919583 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 4/9] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 28 15:42:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 15:42:44.935437 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-aec8c7cb-8d37-44be-91cf-d72b243bfd90 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009797 Sep 28 15:42:44.941943 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 6/10] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 28 15:42:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 15:42:44.946459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-10556dbd-bb39-47de-a250-9c9b99a3d97b tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Calling method '.version_select at 0x7f8fd09fe430>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:45.005550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-10556dbd-bb39-47de-a250-9c9b99a3d97b tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] HTTP exception thrown: Volume b3bd3339-eee8-41a7-85da-0a652e6714b5 could not be found. Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-10556dbd-bb39-47de-a250-9c9b99a3d97b tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Request method failure captured: Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/os-volumes/b3bd3339-eee8-41a7-85da-0a652e6714b5 HTTP/1.1 Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGtxBSM-OQZf6FU8A2S-f4Pm-SXubatNBL4nWDgm2S2gRKa31faRLYef0bmeMVwzQpEy9ycSNmUyiIhjvASFMHUWmdiDPH5_hoBa28FOAFsh5v3t526ImtRmMjIvslASXVfkNt8trxRnf3e8ZZhzio6x_GMmMy1IgFrymZAeVsOkWjk Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:42:45.012073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03e570df30ec409bae5b536144353a81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03e570df30ec409bae5b536144353a81"}]}] Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 1c7906d5da9444dc86c4cd7904d54dc0 Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Volume b3bd3339-eee8-41a7-85da-0a652e6714b5 could not be found. Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'b3bd3339-eee8-41a7-85da-0a652e6714b5'} Sep 28 15:42:45.013328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3bd3339-eee8-41a7-85da-0a652e6714b5 could not be found. (HTTP 404) (Request-ID: req-a0830a30-ef72-4819-8205-094fc5cabf61) Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:45.014154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:42:45.020484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3bd3339-eee8-41a7-85da-0a652e6714b5 could not be found. Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 15:42:45.021556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3bd3339-eee8-41a7-85da-0a652e6714b5 could not be found. Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3bd3339-eee8-41a7-85da-0a652e6714b5 could not be found. Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-10556dbd-bb39-47de-a250-9c9b99a3d97b tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Returning 404 to user: Volume b3bd3339-eee8-41a7-85da-0a652e6714b5 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-10556dbd-bb39-47de-a250-9c9b99a3d97b tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/b3bd3339-eee8-41a7-85da-0a652e6714b5" status: 404 len: 109 microversion: 2.1 time: 0.072057 Sep 28 15:42:45.023531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 5/11] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 15:42:44 2022] DELETE /compute/v2.1/os-volumes/b3bd3339-eee8-41a7-85da-0a652e6714b5 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:42:45.024696 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2a42cff1-ca37-42f9-af5f-58a9c45abb82 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Calling method '.version_select at 0x7f8fd0a3a1f0>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-2a42cff1-ca37-42f9-af5f-58a9c45abb82 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] HTTP exception thrown: Volume aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 could not be found. Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2a42cff1-ca37-42f9-af5f-58a9c45abb82 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Request method failure captured: Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: GET /compute/v2.1/os-volumes/aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 HTTP/1.1 Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGtxBSM-OQZf6FU8A2S-f4Pm-SXubatNBL4nWDgm2S2gRKa31faRLYef0bmeMVwzQpEy9ycSNmUyiIhjvASFMHUWmdiDPH5_hoBa28FOAFsh5v3t526ImtRmMjIvslASXVfkNt8trxRnf3e8ZZhzio6x_GMmMy1IgFrymZAeVsOkWjk Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:42:45.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03e570df30ec409bae5b536144353a81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03e570df30ec409bae5b536144353a81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03e570df30ec409bae5b536144353a81"}]}] Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 03e570df30ec409bae5b536144353a81 Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-VolumesNegativeTest-1709998188 Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 1c7906d5da9444dc86c4cd7904d54dc0 Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-VolumesNegativeTest-1709998188-project Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Volume aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 could not be found. Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'id': 'aac6afd5-16be-41e4-bff0-b4c64cf1d1e4'} Sep 28 15:42:45.120596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 could not be found. (HTTP 404) (Request-ID: req-eaae8719-4feb-4f12-ab36-2046b6e095c5) Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:45.122215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:45.125166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 could not be found. Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 15:42:45.131482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 could not be found. Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 could not be found. Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2a42cff1-ca37-42f9-af5f-58a9c45abb82 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] Returning 404 to user: Volume aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 could not be found. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-2a42cff1-ca37-42f9-af5f-58a9c45abb82 tempest-VolumesNegativeTest-1709998188 tempest-VolumesNegativeTest-1709998188-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/aac6afd5-16be-41e4-bff0-b4c64cf1d1e4" status: 404 len: 109 microversion: 2.1 time: 0.075120 Sep 28 15:42:45.133272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 7/12] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:45 2022] GET /compute/v2.1/os-volumes/aac6afd5-16be-41e4-bff0-b4c64cf1d1e4 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:42:45.662257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-02a0864c-f985-427d-9d25-12d594d85215 tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Calling method '.version_select at 0x7f8fd09fec10>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:45.778736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-02a0864c-f985-427d-9d25-12d594d85215 tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16" status: 200 len: 354 microversion: 2.1 time: 0.124147 Sep 28 15:42:45.780797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 6/13] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:45 2022] GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16 => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:45.794307 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-eb61ae2f-f056-4d2c-a0d5-fd165b4caced tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Calling method '.version_select at 0x7f8fd0a3a9d0>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:45.831081 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bfdf31c0-fde6-462e-acab-da258d3d35db tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd09fe820>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:45.916406 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-eb61ae2f-f056-4d2c-a0d5-fd165b4caced tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16" status: 200 len: 354 microversion: 2.1 time: 0.126288 Sep 28 15:42:45.917786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 8/14] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:45 2022] GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:45.941058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-20ae5bdd-91f5-4f78-92d5-9f165f8de926 tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Calling method '.version_select at 0x7f8fd0a7a790>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:45.968389 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bfdf31c0-fde6-462e-acab-da258d3d35db tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe" status: 200 len: 346 microversion: 2.1 time: 0.141697 Sep 28 15:42:45.979480 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 7/15] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:45 2022] GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe => generated 346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:45.984430 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f033a395-7901-43f5-b889-246a361ad779 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Action: 'create', calling method: .version_select at 0x7f8fd09fe940>, body: {"snapshot": {"volume_id": "04981fef-9c63-4899-bc55-50f34213ecbe", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1020308850"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:46.135794 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-20ae5bdd-91f5-4f78-92d5-9f165f8de926 tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16" status: 202 len: 0 microversion: 2.1 time: 0.199700 Sep 28 15:42:46.136927 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 9/16] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 15:42:45 2022] DELETE /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:42:46.147098 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f3ed2e27-025f-4a63-b615-e778dab05686 tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Calling method '.version_select at 0x7f8fd0b95e50>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:46.252558 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f3ed2e27-025f-4a63-b615-e778dab05686 tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16" status: 200 len: 353 microversion: 2.1 time: 0.110069 Sep 28 15:42:46.253129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 10/17] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:46 2022] GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:46.671952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f033a395-7901-43f5-b889-246a361ad779 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.691303 Sep 28 15:42:46.672947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 8/18] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Sep 28 15:42:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:46.683380 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d435eb8d-0f48-4658-9297-76170bd60dff tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a7af70>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:46.769246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d435eb8d-0f48-4658-9297-76170bd60dff tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 287 microversion: 2.1 time: 0.089540 Sep 28 15:42:46.770082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 11/19] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:46 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:42:46.782000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1b527ed9-2c6a-4309-bcc8-c61053d4fd0c tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a08d30>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:46.931668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1b527ed9-2c6a-4309-bcc8-c61053d4fd0c tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.154063 Sep 28 15:42:46.944617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 9/20] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 28 15:42:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:46.945679 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-41e0c15d-77cd-404c-a184-802de96aac51 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a3ac10>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:47.039695 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-41e0c15d-77cd-404c-a184-802de96aac51 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 287 microversion: 2.1 time: 0.098094 Sep 28 15:42:47.046147 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 12/21] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:46 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:42:47.267993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e02b88c3-79ee-4d9c-a724-f0cef8ab3f9c tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Calling method '.version_select at 0x7f8fd0a08940>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:47.322322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-e02b88c3-79ee-4d9c-a724-f0cef8ab3f9c tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] HTTP exception thrown: Volume eef916b0-4a8e-48c2-bca7-dd3213aa7c16 could not be found. Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e02b88c3-79ee-4d9c-a724-f0cef8ab3f9c tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Request method failure captured: Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16 HTTP/1.1 Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGtwZYhZuSKQR4qbR_Q0ryQg2P0YYvkucdPc4Z1sVYR_cnv5hmwMH_q_azcqvwnqFfKUwgjosfpaSMe2Y3JUuNAL0friBQ6sLVCwW8O0Dm6_ASWIkbsEZAM24H1pGLY1fABuwPyPCSx-T8avlCLoGfVR7DxapsDARvcp4cY2srzcGOg Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: a462c45b3b86441cb2e3c91f35ab8878 Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesGetTestJSON-1468768309 Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:42:47.324558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a462c45b3b86441cb2e3c91f35ab8878"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a462c45b3b86441cb2e3c91f35ab8878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a462c45b3b86441cb2e3c91f35ab8878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a462c45b3b86441cb2e3c91f35ab8878"}]}] Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesGetTestJSON-1468768309 Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: a462c45b3b86441cb2e3c91f35ab8878 Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesGetTestJSON-1468768309 Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesGetTestJSON-1468768309-project Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 0b6ab231db9f4dca9acc01738fc1c639 Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesGetTestJSON-1468768309-project Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Volume eef916b0-4a8e-48c2-bca7-dd3213aa7c16 could not be found. Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'eef916b0-4a8e-48c2-bca7-dd3213aa7c16'} Sep 28 15:42:47.325547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eef916b0-4a8e-48c2-bca7-dd3213aa7c16 could not be found. (HTTP 404) (Request-ID: req-9c774d4f-8934-4c07-84ae-4e60924a5481) Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:47.326252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:47.327652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eef916b0-4a8e-48c2-bca7-dd3213aa7c16 could not be found. Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 15:42:47.328489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eef916b0-4a8e-48c2-bca7-dd3213aa7c16 could not be found. Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eef916b0-4a8e-48c2-bca7-dd3213aa7c16 could not be found. Sep 28 15:42:47.329338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:47.331241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e02b88c3-79ee-4d9c-a724-f0cef8ab3f9c tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] Returning 404 to user: Volume eef916b0-4a8e-48c2-bca7-dd3213aa7c16 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:47.334125 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e02b88c3-79ee-4d9c-a724-f0cef8ab3f9c tempest-VolumesGetTestJSON-1468768309 tempest-VolumesGetTestJSON-1468768309-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16" status: 404 len: 109 microversion: 2.1 time: 0.070196 Sep 28 15:42:47.334861 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 10/22] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:47 2022] GET /compute/v2.1/os-volumes/eef916b0-4a8e-48c2-bca7-dd3213aa7c16 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:42:48.052510 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c42e6cc4-9f8e-49f4-8154-62ddaf6e8aeb tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0991040>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:48.112811 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c42e6cc4-9f8e-49f4-8154-62ddaf6e8aeb tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 287 microversion: 2.1 time: 0.063927 Sep 28 15:42:48.113909 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 13/23] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:48 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:49.128612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2c59ff90-f1a4-4881-a4da-70d63d2835b8 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd13c4940>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:49.210879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2c59ff90-f1a4-4881-a4da-70d63d2835b8 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 287 microversion: 2.1 time: 0.088185 Sep 28 15:42:49.211470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 11/24] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:49 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:50.224498 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0badc075-2248-4873-a80f-004192dba43a tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a3ab80>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:50.277472 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0badc075-2248-4873-a80f-004192dba43a tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 287 microversion: 2.1 time: 0.056643 Sep 28 15:42:50.277885 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 14/25] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:50 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:51.291299 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-06d8f3fa-914d-4792-8225-92ff055283a4 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a081f0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:51.342588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-06d8f3fa-914d-4792-8225-92ff055283a4 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 287 microversion: 2.1 time: 0.055952 Sep 28 15:42:51.343409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 12/26] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:51 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:52.126853 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1911888504", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "networks": [{"uuid": "a0149ca7-8a00-44a0-8025-e81ae392e33a"}]}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:52.356138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7ced93a5-444c-40c5-949c-4ca47a209f11 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a08430>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:52.425030 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] validate_networks() for [('a0149ca7-8a00-44a0-8025-e81ae392e33a', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:42:52.454208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7ced93a5-444c-40c5-949c-4ca47a209f11 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 287 microversion: 2.1 time: 0.101648 Sep 28 15:42:52.456086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 13/27] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:52 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:42:53.469080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-065f9b9c-d754-4f8c-a422-350affe4854e tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd09fe430>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:53.536965 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-065f9b9c-d754-4f8c-a422-350affe4854e tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 288 microversion: 2.1 time: 0.072248 Sep 28 15:42:53.537700 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 14/28] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:53 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 288 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:42:53.550217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e125f7db-226b-454b-bd1a-2b439710b00d tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd09feee0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:53.837367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e125f7db-226b-454b-bd1a-2b439710b00d tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 202 len: 0 microversion: 2.1 time: 0.290758 Sep 28 15:42:53.838238 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 15/29] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 28 15:42:53 2022] DELETE /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:42:53.850388 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fc53b1ef-a312-4557-9376-6db2ffd0d753 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a085e0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:53.984066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fc53b1ef-a312-4557-9376-6db2ffd0d753 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 200 len: 287 microversion: 2.1 time: 0.141404 Sep 28 15:42:53.985028 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 16/30] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:53 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 287 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:54.996867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4233f5c3-8e49-49b2-93a0-4feec4754a10 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a08280>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:55.047183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-4233f5c3-8e49-49b2-93a0-4feec4754a10 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] HTTP exception thrown: Snapshot 516e5723-876b-4d35-aa4d-b6d086b112e1 could not be found. Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4233f5c3-8e49-49b2-93a0-4feec4754a10 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Request method failure captured: Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 HTTP/1.1 Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGtwBnLvAqdjREYE4_NkjxBGUaq_PCaj8sjR3cyOYQ2iqowEI8FZETS9Ity5J8GMCJSMjgM7kciC5JIpaE4uroqyFOGs2oE1NzjzaxB059V6dY7alzyzcURnXdqJCrmpW6TbwoI_whMIzphIy0i6zxPSC52MbAKY7Z-yqVEyTat8qQ4 Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 3f7d8432bdc442a1bc9357ceb9a96c60 Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:42:55.049561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f7d8432bdc442a1bc9357ceb9a96c60"}]}] Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 3f7d8432bdc442a1bc9357ceb9a96c60 Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesSnapshotsTestJSON-282451373-project Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: d26716afd68a4fcfbbc323be98ea43d7 Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-282451373-project Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Snapshot 516e5723-876b-4d35-aa4d-b6d086b112e1 could not be found. Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '516e5723-876b-4d35-aa4d-b6d086b112e1'} Sep 28 15:42:55.050740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 516e5723-876b-4d35-aa4d-b6d086b112e1 could not be found. (HTTP 404) (Request-ID: req-1e3b10d4-ac3f-4abc-b10a-03416024d13f) Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:55.051455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:55.052516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 516e5723-876b-4d35-aa4d-b6d086b112e1 could not be found. Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 28 15:42:55.053985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 516e5723-876b-4d35-aa4d-b6d086b112e1 could not be found. Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 516e5723-876b-4d35-aa4d-b6d086b112e1 could not be found. Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4233f5c3-8e49-49b2-93a0-4feec4754a10 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Returning 404 to user: Snapshot 516e5723-876b-4d35-aa4d-b6d086b112e1 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:55.056019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4233f5c3-8e49-49b2-93a0-4feec4754a10 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1" status: 404 len: 111 microversion: 2.1 time: 0.058226 Sep 28 15:42:55.057575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 17/31] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 28 15:42:54 2022] GET /compute/v2.1/os-snapshots/516e5723-876b-4d35-aa4d-b6d086b112e1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:42:55.065594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2d46d4ac-206a-41f8-8bf7-787c0a09734b tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd13c48b0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:55.299744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2d46d4ac-206a-41f8-8bf7-787c0a09734b tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe" status: 202 len: 0 microversion: 2.1 time: 0.242016 Sep 28 15:42:55.300321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 18/32] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 15:42:55 2022] DELETE /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:42:55.315921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9594fdad-a035-4fa7-9896-02f46ddfe1a1 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a08940>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:55.477078 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9594fdad-a035-4fa7-9896-02f46ddfe1a1 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe" status: 200 len: 345 microversion: 2.1 time: 0.170252 Sep 28 15:42:55.477902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 19/33] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:55 2022] GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:55.528852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:42:55.530372 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:42:55.530947 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:42:55.531354 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:42:55.532736 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:42:55.628476 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:55.629554 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:55.630685 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:55.632413 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:55.633099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:55.634277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:55.697145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Getting quotas for project 524d39d780b2426cbacde028e1b061de. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:42:55.707512 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Getting quotas for user 76dc93ac31604022a522b47559ab31b5 and project 524d39d780b2426cbacde028e1b061de. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:42:55.724058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:42:55.727770 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:42:55.836161 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8a88f72e-7237-4ecf-abed-f12aa9e10482 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.388560 Sep 28 15:42:55.844899 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 15/34] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:42:55.850644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a2a98189-a93f-4655-b2a9-ac3dd69ca718 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:55.851104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a2a98189-a93f-4655-b2a9-ac3dd69ca718 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:56.009309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a2a98189-a93f-4655-b2a9-ac3dd69ca718 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:56.040166 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a2a98189-a93f-4655-b2a9-ac3dd69ca718 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1215 microversion: 2.1 time: 0.193675 Sep 28 15:42:56.041020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 20/35] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:55 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:56.493176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bdce159e-7235-48e9-a986-b01ba4edbb52 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a080d0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:56.553719 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-bdce159e-7235-48e9-a986-b01ba4edbb52 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] HTTP exception thrown: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bdce159e-7235-48e9-a986-b01ba4edbb52 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Request method failure captured: Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe HTTP/1.1 Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGtwBnLvAqdjREYE4_NkjxBGUaq_PCaj8sjR3cyOYQ2iqowEI8FZETS9Ity5J8GMCJSMjgM7kciC5JIpaE4uroqyFOGs2oE1NzjzaxB059V6dY7alzyzcURnXdqJCrmpW6TbwoI_whMIzphIy0i6zxPSC52MbAKY7Z-yqVEyTat8qQ4 Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 3f7d8432bdc442a1bc9357ceb9a96c60 Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:42:56.556206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f7d8432bdc442a1bc9357ceb9a96c60"}]}] Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 3f7d8432bdc442a1bc9357ceb9a96c60 Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesSnapshotsTestJSON-282451373-project Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: d26716afd68a4fcfbbc323be98ea43d7 Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-282451373-project Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '04981fef-9c63-4899-bc55-50f34213ecbe'} Sep 28 15:42:56.557335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. (HTTP 404) (Request-ID: req-59543cd4-a476-4371-9857-896aa657f667) Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.557996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:56.559203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 15:42:56.560094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bdce159e-7235-48e9-a986-b01ba4edbb52 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Returning 404 to user: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bdce159e-7235-48e9-a986-b01ba4edbb52 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe" status: 404 len: 109 microversion: 2.1 time: 0.069456 Sep 28 15:42:56.563123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 21/36] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:56 2022] GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:42:56.567996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-65896478-a493-4fab-8ec6-90e4a1206468 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd09aeee0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:56.640314 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-65896478-a493-4fab-8ec6-90e4a1206468 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] HTTP exception thrown: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-65896478-a493-4fab-8ec6-90e4a1206468 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Request method failure captured: Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe HTTP/1.1 Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGtwBnLvAqdjREYE4_NkjxBGUaq_PCaj8sjR3cyOYQ2iqowEI8FZETS9Ity5J8GMCJSMjgM7kciC5JIpaE4uroqyFOGs2oE1NzjzaxB059V6dY7alzyzcURnXdqJCrmpW6TbwoI_whMIzphIy0i6zxPSC52MbAKY7Z-yqVEyTat8qQ4 Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 3f7d8432bdc442a1bc9357ceb9a96c60 Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:42:56.642462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f7d8432bdc442a1bc9357ceb9a96c60"}]}] Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 3f7d8432bdc442a1bc9357ceb9a96c60 Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesSnapshotsTestJSON-282451373-project Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: d26716afd68a4fcfbbc323be98ea43d7 Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-282451373-project Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '04981fef-9c63-4899-bc55-50f34213ecbe'} Sep 28 15:42:56.643770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. (HTTP 404) (Request-ID: req-0be4efb7-f5cb-4095-a97d-b792089fa060) Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.644581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:42:56.645588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 15:42:56.646610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.647509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.649355 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-65896478-a493-4fab-8ec6-90e4a1206468 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Returning 404 to user: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:56.650381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-65896478-a493-4fab-8ec6-90e4a1206468 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe" status: 404 len: 109 microversion: 2.1 time: 0.086268 Sep 28 15:42:56.655891 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 22/37] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 15:42:56 2022] DELETE /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:42:56.682001 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8c541ca7-d8b0-4e7f-ba38-06580b69f0b9 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Calling method '.version_select at 0x7f8fd0a084c0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:56.821359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-8c541ca7-d8b0-4e7f-ba38-06580b69f0b9 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] HTTP exception thrown: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8c541ca7-d8b0-4e7f-ba38-06580b69f0b9 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Request method failure captured: Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe HTTP/1.1 Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGtwBnLvAqdjREYE4_NkjxBGUaq_PCaj8sjR3cyOYQ2iqowEI8FZETS9Ity5J8GMCJSMjgM7kciC5JIpaE4uroqyFOGs2oE1NzjzaxB059V6dY7alzyzcURnXdqJCrmpW6TbwoI_whMIzphIy0i6zxPSC52MbAKY7Z-yqVEyTat8qQ4 Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 3f7d8432bdc442a1bc9357ceb9a96c60 Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:42:56.823450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f7d8432bdc442a1bc9357ceb9a96c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f7d8432bdc442a1bc9357ceb9a96c60"}]}] Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 3f7d8432bdc442a1bc9357ceb9a96c60 Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-282451373 Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesSnapshotsTestJSON-282451373-project Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: d26716afd68a4fcfbbc323be98ea43d7 Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-282451373-project Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '04981fef-9c63-4899-bc55-50f34213ecbe'} Sep 28 15:42:56.824766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. (HTTP 404) (Request-ID: req-04f873c1-351a-4892-8634-2cb9aea183f9) Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.825599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:42:56.827675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 15:42:56.829843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8c541ca7-d8b0-4e7f-ba38-06580b69f0b9 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] Returning 404 to user: Volume 04981fef-9c63-4899-bc55-50f34213ecbe could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8c541ca7-d8b0-4e7f-ba38-06580b69f0b9 tempest-VolumesSnapshotsTestJSON-282451373 tempest-VolumesSnapshotsTestJSON-282451373-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe" status: 404 len: 109 microversion: 2.1 time: 0.171113 Sep 28 15:42:56.831610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 23/38] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:42:56 2022] GET /compute/v2.1/os-volumes/04981fef-9c63-4899-bc55-50f34213ecbe => generated 109 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:42:57.066916 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4802dbd3-9173-40cf-b991-b4784049f41a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:57.068318 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4802dbd3-9173-40cf-b991-b4784049f41a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:57.289720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4802dbd3-9173-40cf-b991-b4784049f41a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:57.305449 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4802dbd3-9173-40cf-b991-b4784049f41a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1215 microversion: 2.1 time: 0.242906 Sep 28 15:42:57.306034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 24/39] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:57 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:57.425802 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2097085066", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:57.552226 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] validate_networks() for [('cdd92b40-f166-4b7e-8e83-24dc81134fe4', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:42:58.333847 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:58.333847 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:58.343714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:58.346222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:58.347715 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:58.352039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:58.353458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:58.355235 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:58.391453 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:42:58.392449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:42:58.393441 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:42:58.395928 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:42:58.396544 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:42:58.426208 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:58.427037 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:58.433071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:58.434963 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:58.437363 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:58.438551 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:58.474940 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Getting quotas for project 22d9fd2a9bec45938dd18540b1334a3b. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:42:58.480952 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Getting quotas for user d8581d46699041d5a4dcb8a43034863e and project 22d9fd2a9bec45938dd18540b1334a3b. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:42:58.506601 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:42:58.512347 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:42:58.615857 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8b1bfff2-1f92-4cd1-9ce4-dba781770fb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.241013 Sep 28 15:42:58.627549 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 16/40] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:42:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:42:58.640102 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-248719e7-dadd-40d3-b921-a606a122ccbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:58.644523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-248719e7-dadd-40d3-b921-a606a122ccbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:58.679490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:58.695888 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-514f12ad-6d22-4399-8ab1-036335444575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1219 microversion: 2.1 time: 0.366384 Sep 28 15:42:58.699670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 25/41] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:58 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1219 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:58.847766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-248719e7-dadd-40d3-b921-a606a122ccbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:58.907260 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-248719e7-dadd-40d3-b921-a606a122ccbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1222 microversion: 2.1 time: 0.277220 Sep 28 15:42:58.913043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 17/42] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:58 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1222 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:59.165532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1622194992", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:59.390638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] validate_networks() for [('cdd92b40-f166-4b7e-8e83-24dc81134fe4', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:42:59.724408 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:59.726451 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:59.736176 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.737887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.738534 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.739934 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.741482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.742066 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.890971 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:59.908379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e36f6e94-83a6-4084-8c34-817af2840d3e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1219 microversion: 2.1 time: 0.190254 Sep 28 15:42:59.910810 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 18/43] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:59 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:00.768518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:43:00.769367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:43:00.770838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:43:00.770838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:43:00.771561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:43:00.804509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.804991 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.805443 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.817381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.817937 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.818382 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.917913 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Getting quotas for project 22d9fd2a9bec45938dd18540b1334a3b. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:43:00.932201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:00.933357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:00.938219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Getting quotas for user d8581d46699041d5a4dcb8a43034863e and project 22d9fd2a9bec45938dd18540b1334a3b. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:43:00.947651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.948146 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.948657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.952913 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.953469 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.953910 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.971549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:43:00.978788 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:43:01.072002 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:01.084070 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5bdbc121-9087-4620-855e-1de3bc4dbde2 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1219 microversion: 2.1 time: 0.155745 Sep 28 15:43:01.087470 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 19/44] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:00 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:01.148425 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-97b44542-5393-4ee2-a0c0-814c60758fc0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.987407 Sep 28 15:43:01.156776 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 26/45] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:42:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:43:01.160800 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b38c3b7f-bf90-4694-94b7-227f97acc036 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:01.161536 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b38c3b7f-bf90-4694-94b7-227f97acc036 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:01.289422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b38c3b7f-bf90-4694-94b7-227f97acc036 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:01.303104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b38c3b7f-bf90-4694-94b7-227f97acc036 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1222 microversion: 2.1 time: 0.146304 Sep 28 15:43:01.303960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 20/46] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:01 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:02.111157 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:02.111777 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:02.120469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:02.120953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:02.121386 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:02.125067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:02.125904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:02.126592 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:02.268717 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:02.281779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9422eb18-f15c-4fe0-97f4-bb706b36141d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1275 microversion: 2.1 time: 0.175867 Sep 28 15:43:02.282366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 27/47] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:02 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:02.330477 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:02.331292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:02.348222 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:02.349975 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:02.350953 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:02.353335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:02.356162 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:02.358005 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:02.472968 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:02.484803 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b5ffc4ad-7e74-4305-a377-cf5cb746c176 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1218 microversion: 2.1 time: 0.163251 Sep 28 15:43:02.488099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 21/48] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:02 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:03.310183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:03.313239 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:03.328668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:03.329168 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:03.329605 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:03.330315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:03.333066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:03.334885 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:03.511297 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:03.511920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:03.526572 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:03.531612 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:03.532074 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:03.532856 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:03.533322 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:03.533754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:03.649169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:03.665730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-97312a8d-edb4-4d8b-a51a-f46c2ff78042 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1273 microversion: 2.1 time: 0.354650 Sep 28 15:43:03.670077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 28/49] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:03 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:03.792508 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:03.805769 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7febf3ea-b4a3-4cbe-92ac-820577694ed3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1274 microversion: 2.1 time: 0.299380 Sep 28 15:43:03.830741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 22/50] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:03 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1274 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:04.699647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:04.700286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:04.712638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.713468 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.715017 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.715976 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.716438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.717364 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.840997 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:04.841706 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:04.847814 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.848305 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.848736 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.849428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.849877 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.850293 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:05.047892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:05.069494 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8ceaa7b3-ccc2-43e2-922a-5b008d4f5652 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1280 microversion: 2.1 time: 0.232101 Sep 28 15:43:05.074562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 23/51] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:04 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:05.760191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:05.771865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-76ffcd05-705a-45a8-918f-ca8d07d10efc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 1.076127 Sep 28 15:43:05.773077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 29/52] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:04 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:06.100186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:06.100943 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:06.110573 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:06.116663 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:06.117351 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:06.120515 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:06.121000 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:06.127646 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:06.414505 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:06.441466 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f7af244c-9c39-4f65-ab00-cf475a688e0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1280 microversion: 2.1 time: 0.345092 Sep 28 15:43:06.444035 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 24/53] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:06 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:06.497115 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-389620ae-ca96-4504-807a-cc9fd5d93323 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcffef9d0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:06.737188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-389620ae-ca96-4504-807a-cc9fd5d93323 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9ac7c086-619a-4931-9fb7-c12914f4f9d4" status: 200 len: 350 microversion: 2.1 time: 0.245004 Sep 28 15:43:06.737785 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 30/54] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:43:06 2022] GET /compute/v2.1/os-volumes/9ac7c086-619a-4931-9fb7-c12914f4f9d4 => generated 350 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:06.799185 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:06.799797 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:06.805679 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:06.806162 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:06.806630 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:06.807312 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:06.807758 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:06.809032 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.047352 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:07.057130 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3f95930b-c300-4e5a-a968-ea25a7e12732 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.262681 Sep 28 15:43:07.071990 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 25/55] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:06 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:07.173846 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-8bedbbad-6300-4ee4-a0d4-239d64ff463b req-b0030157-3854-4dd0-a10b-dbcceeb8f848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd97fd33-7baf-4398-98d7-0f5aefb9b3c1", "tag": "c76a912a-3995-45da-b353-a6d34615847e"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:07.187732 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8bedbbad-6300-4ee4-a0d4-239d64ff463b req-b0030157-3854-4dd0-a10b-dbcceeb8f848 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.188330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8bedbbad-6300-4ee4-a0d4-239d64ff463b req-b0030157-3854-4dd0-a10b-dbcceeb8f848 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.188834 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8bedbbad-6300-4ee4-a0d4-239d64ff463b req-b0030157-3854-4dd0-a10b-dbcceeb8f848 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.208327 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-8bedbbad-6300-4ee4-a0d4-239d64ff463b req-b0030157-3854-4dd0-a10b-dbcceeb8f848 service nova] Creating event network-changed:c76a912a-3995-45da-b353-a6d34615847e for instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 on hv-cinder-85931 Sep 28 15:43:07.208881 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8bedbbad-6300-4ee4-a0d4-239d64ff463b req-b0030157-3854-4dd0-a10b-dbcceeb8f848 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 15:43:07.209269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8bedbbad-6300-4ee4-a0d4-239d64ff463b req-b0030157-3854-4dd0-a10b-dbcceeb8f848 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 15:43:07.210328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.210811 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.211263 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.211946 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.212390 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.212815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.221956 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.compute.rpcapi [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 15:43:07.222877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] Releasing lock "compute-rpcapi-router" {{(pid=126996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 15:43:07.240727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7c046f0f-e9a3-45b2-b18a-106b99aa3e79 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135877 Sep 28 15:43:07.241337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 31/56] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:07.471184 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:07.471778 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:07.478069 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.478586 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.479018 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.479824 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.480266 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.480955 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.613700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:07.623882 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-236c52db-8068-4575-8ad1-c01c48d14643 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.157131 Sep 28 15:43:07.624726 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 26/57] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:07 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:08.080464 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:08.081163 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:08.087295 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:08.087773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:08.088201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:08.088886 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:08.089335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:08.089756 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:08.225600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:08.233268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b6523dae-67e6-4300-9170-2fb1af3b6c7e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.157624 Sep 28 15:43:08.233837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 32/58] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:08 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:08.648681 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:08.649297 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:08.651625 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=4 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:08.657427 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:08.657913 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:08.658358 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:08.659096 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:08.659540 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:08.659966 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:08.825527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:08.833491 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cdbce661-a44e-4afc-afa2-c41ab156eceb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.188843 Sep 28 15:43:08.834147 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 27/59] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:08 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:09.255413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:09.256019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:09.262163 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:09.262815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:09.263256 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:09.263952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:09.264404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:09.264855 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:09.395654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:09.403193 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ae04d8b7-cba4-4688-8394-5ab73e48532e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.151562 Sep 28 15:43:09.403757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 33/60] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:09 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:09.857188 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:09.859048 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:09.865641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:09.866333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:09.867196 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:09.869050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:09.869880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:09.870547 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:10.067918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:10.077087 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-51fdc624-5279-487d-b809-874073468f98 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.224428 Sep 28 15:43:10.078480 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 28/61] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:09 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:10.436359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:10.438601 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:10.461841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:10.462595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:10.463226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:10.463880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:10.464387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:10.465088 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:10.650109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:10.658703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3eb0e740-9568-4635-8182-cac5ba282d73 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.234116 Sep 28 15:43:10.659530 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 34/62] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:10 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:11.101275 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:11.102076 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:11.109819 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:11.110547 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:11.110957 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:11.111893 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:11.112596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:11.113563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:11.295242 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=16 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:11.302899 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:11.315369 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-9fe8477c-b322-4208-88b4-2d88d8469eb3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.218482 Sep 28 15:43:11.316061 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 29/63] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:11 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:11.697378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:11.699458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:11.705696 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=10 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:11.713956 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:11.715330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:11.716468 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:11.718128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:11.719286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:11.720428 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:11.889189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:11.897374 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1f5c5777-d312-449f-8cf5-f3f2c94d8306 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.219073 Sep 28 15:43:11.898348 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 35/64] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:11 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:12.343296 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:12.343928 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:12.349840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:12.350299 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:12.350779 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:12.351539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:12.351985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:12.352401 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:12.491641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:12.500026 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d3fd8d5a-ce2e-4425-9be3-9f7c550a5e50 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.160685 Sep 28 15:43:12.500587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 30/65] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:12 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:12.921630 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:12.922241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:12.928218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:12.928691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:12.929118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:12.929802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:12.930248 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:12.930684 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:13.082803 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:13.089901 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e30ced38-f635-4300-ac08-15c8e7f8d6c1 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.169590 Sep 28 15:43:13.093249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 36/66] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:12 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:13.522598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:13.523179 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:13.529671 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:13.530153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:13.530612 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:13.531295 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:13.531743 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:13.532168 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:13.678559 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:13.687297 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f04d68e9-141f-43f5-9588-fec4778abc63 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.168668 Sep 28 15:43:13.687949 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 31/67] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:13 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:14.113070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:14.113684 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:14.122306 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:14.122822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:14.123252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:14.124516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:14.124963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:14.125381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:14.298590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:14.306190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3604d3de-870e-4af1-94ec-5d6e09c60d44 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.197032 Sep 28 15:43:14.306782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 37/68] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:14 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:14.710658 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:14.712195 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:14.718717 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:14.719194 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:14.719621 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:14.720301 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:14.720751 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:14.721165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:14.849248 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:14.863032 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-89dec06b-1fd5-4561-91a1-b8c8a7e38648 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.155728 Sep 28 15:43:14.864011 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 32/69] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:14 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:15.330098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.330714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:15.337437 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:15.342680 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:15.343342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:15.344251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:15.345902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:15.346556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:15.510316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:15.518002 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3a069134-54f1-4929-a953-62f851b62221 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.192726 Sep 28 15:43:15.518583 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 38/70] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:15 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:15.886346 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.886958 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:15.892894 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:15.893375 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:15.893807 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:15.894579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:15.895038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:15.895457 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:16.023742 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:16.031880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1c09f366-80f4-473f-8dd7-e03105c792f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.149402 Sep 28 15:43:16.032443 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 33/71] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:15 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:16.540419 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:16.541023 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:16.546913 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:16.547379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:16.547801 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:16.548469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:16.548906 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:16.549319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:16.681886 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:16.690504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9c6977df-8ed9-44d0-8b8c-184583466e49 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.154002 Sep 28 15:43:16.691069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 39/72] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:16 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:17.054649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:17.055400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:17.063609 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:17.064182 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:17.064870 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:17.065740 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:17.066197 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:17.066656 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:17.203662 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:17.207104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:17.212870 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ed7598c5-6a3e-4e6c-803e-00210c3fac36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.162061 Sep 28 15:43:17.213443 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 34/73] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:17 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:17.713080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:17.713699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:17.715530 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:17.721395 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:17.721866 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:17.722289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:17.723060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:17.723500 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:17.723909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:17.943216 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:17.957476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dc05ebf9-ff72-4776-89a2-c94a55f4650d tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.248049 Sep 28 15:43:17.980572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 40/74] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:17 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:18.235321 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:18.236072 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:18.242703 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:18.243335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:18.243831 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:18.245403 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:18.245939 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:18.246452 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:18.515666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:18.528597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-bc09e86b-c1b1-4a42-9711-470999d6bc89 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.297065 Sep 28 15:43:18.530030 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 35/75] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:18 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:18.993474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:18.994298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:19.002675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:19.004279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:19.004968 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:19.006296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:19.007447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:19.008349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:19.235323 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:19.248336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2eb2370a-bc97-4ee6-83d8-8a3012287e0e tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.258860 Sep 28 15:43:19.248958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 41/76] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:18 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:19.553387 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:19.562745 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:19.569348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:19.570086 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:19.570608 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:19.573670 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:19.575339 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:19.578863 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:19.812621 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:19.820562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cb18f243-73d6-4398-b192-8a3fcec7b0e5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.272307 Sep 28 15:43:19.821279 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 36/77] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:19 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:20.011735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5e7b8181-6b89-452a-a22c-1d99f284122c tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcffb53a0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:20.067545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5e7b8181-6b89-452a-a22c-1d99f284122c tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3857303a-7cba-4326-929b-19222ca51a9e" status: 200 len: 349 microversion: 2.1 time: 0.059916 Sep 28 15:43:20.068110 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 42/78] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:43:20 2022] GET /compute/v2.1/os-volumes/3857303a-7cba-4326-929b-19222ca51a9e => generated 349 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:20.273914 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:20.275786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:20.283040 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:20.284080 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:20.284749 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:20.286293 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:20.286984 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:20.287596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:20.525931 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:20.540101 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1fcc60b1-00be-4025-a5d7-7adbbe004b12 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.270242 Sep 28 15:43:20.554243 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 37/79] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:20 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:20.846265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:20.846988 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:20.852892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:20.853539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:20.854611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:20.855302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:20.855740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:20.856353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:21.009076 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:21.019137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-46eeb669-bc1c-4f91-853e-ba3f53a7271c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.177314 Sep 28 15:43:21.034549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 43/80] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:20 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:21.565158 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:21.566345 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:21.568433 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:21.573534 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:21.574233 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:21.574753 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:21.575449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:21.575890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:21.576382 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:21.744130 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:21.756454 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c94cbbc9-b14a-43f0-ab87-a381ba77ab1a tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.195504 Sep 28 15:43:21.757302 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 38/81] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:21 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:22.041171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:22.041943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:22.044095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:22.051572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:22.052072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:22.052504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:22.053404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:22.053856 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:22.054272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:22.059969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=97 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:22.207056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:22.215261 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-27aeb68b-a784-4ff8-b1ee-4667fd7e2623 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.177935 Sep 28 15:43:22.215839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 44/82] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:22 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:22.780678 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:22.781840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:22.788284 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:22.788771 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:22.789393 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:22.790285 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:22.790930 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:22.791539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:22.945763 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:22.956188 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e63197a5-9f7a-4676-a7a2-cadce562a998 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.179712 Sep 28 15:43:22.956890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 39/83] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:22 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:23.240359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:23.241018 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:23.255713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:23.259841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:23.260280 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:23.261122 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:23.261482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:23.261876 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:23.411689 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:23.420234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-033d51a5-a564-4a64-837b-51fd60a947df tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.185051 Sep 28 15:43:23.420802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 45/84] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:23 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:23.981480 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:23.982092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:23.988935 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:23.989415 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:23.989845 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:23.990681 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:23.991154 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:23.991574 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:24.445317 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:24.446386 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:24.454120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:24.454795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:24.455522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:24.456321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:24.456955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:24.457391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:24.581454 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:24.594262 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1e240b6e-d19e-4470-86d5-962db06797aa tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.617199 Sep 28 15:43:24.607087 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 40/85] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:23 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:24.787250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:24.798750 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d5767a01-2b74-483b-95e0-64de47cf94a9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.357942 Sep 28 15:43:24.799338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 46/86] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:24 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:25.618751 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:25.619500 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:25.629249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:25.631649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:25.639432 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:25.643225 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:25.643672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:25.644104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:25.758041 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-0ee0fedb-cbd5-49c2-9dc3-d0c2a1e93acf req-aad1af21-e0d5-47f6-908e-84386dfab82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cfd6533-e103-4f9d-905a-d839c4834f77", "tag": "b1dc2b46-1b60-48c5-ab08-4ee2cbc934b7"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:25.767994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0ee0fedb-cbd5-49c2-9dc3-d0c2a1e93acf req-aad1af21-e0d5-47f6-908e-84386dfab82c service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:25.768468 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0ee0fedb-cbd5-49c2-9dc3-d0c2a1e93acf req-aad1af21-e0d5-47f6-908e-84386dfab82c service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:25.769442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0ee0fedb-cbd5-49c2-9dc3-d0c2a1e93acf req-aad1af21-e0d5-47f6-908e-84386dfab82c service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:25.781521 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-0ee0fedb-cbd5-49c2-9dc3-d0c2a1e93acf req-aad1af21-e0d5-47f6-908e-84386dfab82c service nova] Creating event network-changed:b1dc2b46-1b60-48c5-ab08-4ee2cbc934b7 for instance 3cfd6533-e103-4f9d-905a-d839c4834f77 on hv-cinder-85931 Sep 28 15:43:25.788268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-0ee0fedb-cbd5-49c2-9dc3-d0c2a1e93acf req-aad1af21-e0d5-47f6-908e-84386dfab82c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089068 Sep 28 15:43:25.789434 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 47/87] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:43:25.819630 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:25.828692 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f0fb4180-950f-4772-a726-6be5cad21d95 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.213831 Sep 28 15:43:25.830973 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:25.831838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:25.836602 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 41/88] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:25 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:25.840485 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:25.841418 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:25.842346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:25.843537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:25.843999 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:25.844424 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:25.995450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:26.004194 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-52d71d6c-0d12-454f-9088-891280fce5f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.184120 Sep 28 15:43:26.004769 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 48/89] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:25 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:26.851464 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:26.852202 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:26.858178 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:26.858697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:26.859134 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:26.859825 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:26.860276 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:26.860696 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:26.997234 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:27.005056 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f2c0838d-9dab-4219-bb50-5c6615b3a7f6 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.157430 Sep 28 15:43:27.005626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 42/90] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:26 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:27.026748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:27.027358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:27.033950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:27.034434 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:27.034913 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:27.035623 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:27.036061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:27.036470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:27.167597 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:27.175809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-adac5420-e930-491d-ba3c-ab4ea4af89d0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.152786 Sep 28 15:43:27.176386 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 49/91] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:27 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:27.807935 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-30856f5e-75ca-4316-a410-94a647672944 req-57953793-a7b2-4d8a-833a-a540a1ba7e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cbbb80-d096-4b55-bfd8-417ff2f04c26", "tag": "cc793622-d700-461d-abc7-6af34373f544"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:27.820869 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-30856f5e-75ca-4316-a410-94a647672944 req-57953793-a7b2-4d8a-833a-a540a1ba7e28 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:27.821353 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-30856f5e-75ca-4316-a410-94a647672944 req-57953793-a7b2-4d8a-833a-a540a1ba7e28 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:27.821778 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-30856f5e-75ca-4316-a410-94a647672944 req-57953793-a7b2-4d8a-833a-a540a1ba7e28 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:27.840969 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-30856f5e-75ca-4316-a410-94a647672944 req-57953793-a7b2-4d8a-833a-a540a1ba7e28 service nova] Creating event network-changed:cc793622-d700-461d-abc7-6af34373f544 for instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 on hv-cinder-85931 Sep 28 15:43:27.841494 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-30856f5e-75ca-4316-a410-94a647672944 req-57953793-a7b2-4d8a-833a-a540a1ba7e28 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 15:43:27.842375 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-30856f5e-75ca-4316-a410-94a647672944 req-57953793-a7b2-4d8a-833a-a540a1ba7e28 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 15:43:27.843416 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:27.843868 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:27.844293 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:27.845003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:27.845449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:27.845871 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:27.854535 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.compute.rpcapi [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 15:43:27.855422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] Releasing lock "compute-rpcapi-router" {{(pid=126997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 15:43:27.871190 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b9485f6f-d533-4a4e-85d2-f8995d5abac7 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066943 Sep 28 15:43:27.871787 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 43/92] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:28.027703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:28.028311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:28.034802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:28.035284 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:28.035711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:28.036394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:28.036838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:28.037256 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:28.170966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:28.178964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-220dffba-652b-4f21-bdbc-6de97351b412 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.155027 Sep 28 15:43:28.179578 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 50/93] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:28 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:28.200795 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:28.202128 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:28.208925 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:28.209418 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:28.209851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:28.210560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:28.211007 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:28.211625 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:28.355450 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:28.363016 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8373341b-5d00-4adf-8e86-635e944800e9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.166739 Sep 28 15:43:28.363597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 44/94] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:28 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:29.206313 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:29.207941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:29.213896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:29.214493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:29.215142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:29.221756 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:29.221756 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:29.222224 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:29.387900 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:29.388676 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:29.395967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:29.396459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:29.396900 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:29.397742 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:29.398192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:29.398644 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:29.846930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:29.855416 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:29.855742 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2448aee4-3e19-4a2f-8067-160dadd64a46 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.657015 Sep 28 15:43:29.856569 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 51/95] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:29 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:29.864680 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b5fba59d-24ba-4352-ae03-c913f3c85d0d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.481918 Sep 28 15:43:29.865969 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 45/96] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:29 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:30.880504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:30.881260 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:30.889161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:30.890251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:30.890762 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:30.890924 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:30.897641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:30.899053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:30.899744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:30.900376 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:30.904434 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:30.904920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:30.905346 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:30.909074 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:30.909074 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:30.909074 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:31.267729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:31.275965 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-864480a5-979c-4d3f-84f4-fb406306b568 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.399235 Sep 28 15:43:31.276670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 52/97] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:30 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:31.290104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-141c8cc1-12f0-4b4f-8c4f-271fd0f01eda tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcffb5160>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:31.306788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:31.323189 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-696b1ed7-b674-48cd-8309-ed8e79ae9aad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.439227 Sep 28 15:43:31.324339 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 46/98] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:30 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:31.361793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-141c8cc1-12f0-4b4f-8c4f-271fd0f01eda tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1db660f3-875b-4edb-8a04-316b627c6c68" status: 200 len: 351 microversion: 2.1 time: 0.084096 Sep 28 15:43:31.362608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 53/99] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/os-volumes/1db660f3-875b-4edb-8a04-316b627c6c68 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:31.378867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-79fd7800-d1a1-43dd-8cc6-b71897c5b05b tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcbf84940>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:31.486704 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-79fd7800-d1a1-43dd-8cc6-b71897c5b05b tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.111909 Sep 28 15:43:31.487271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 47/100] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:31.501109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f47481d8-0b2e-4eb6-9b6f-6d0247fa9912 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcffb5e50>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:31.599830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f47481d8-0b2e-4eb6-9b6f-6d0247fa9912 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.102432 Sep 28 15:43:31.600785 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 54/101] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:31.615213 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e38a312f-370e-4e5f-ba8f-d736755e6896 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcbf6ee50>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:31.702445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e38a312f-370e-4e5f-ba8f-d736755e6896 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.090981 Sep 28 15:43:31.703389 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 48/102] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:31.717025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ab3ae2ca-d080-4f7f-9f99-13ffc5635784 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcfff9f70>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:31.801268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ab3ae2ca-d080-4f7f-9f99-13ffc5635784 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.088497 Sep 28 15:43:31.802551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 55/103] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:31.816828 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ae85a0ff-d83d-4436-a17e-683793b7751a tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcbeec4c0>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:31.919172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ae85a0ff-d83d-4436-a17e-683793b7751a tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.106031 Sep 28 15:43:31.925128 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 49/104] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:31.936705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-eefaa1d8-a52f-4521-977c-805517a5ff4b tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcffefca0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.180602 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-eefaa1d8-a52f-4521-977c-805517a5ff4b tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.247869 Sep 28 15:43:32.192116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 56/105] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:32.194953 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-85c88bfd-945c-401f-b9fe-50d6397fdbef tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcbf0e820>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.299309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.300084 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:32.306872 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.307797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.308751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.309455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.311336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.311947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.333597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-85c88bfd-945c-401f-b9fe-50d6397fdbef tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.141192 Sep 28 15:43:32.334350 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 50/106] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Sep 28 15:43:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:32.348758 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.349622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:32.355875 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.356351 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.357012 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.358060 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.358571 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.358993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.504789 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:32.515244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2936f0ac-3c3d-4390-af04-22955c3a8789 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.220117 Sep 28 15:43:32.516379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 57/107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:32 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:32.521659 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-43ea80b3-ebd6-49f7-b921-a197625c3518 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] Calling method '.version_select at 0x7f8fcfff9040>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.541421 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:32.549378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f8a8b971-64c6-4b3f-af99-c00dbf1ea0b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.205014 Sep 28 15:43:32.550727 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 51/108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:32 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:32.621228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-43ea80b3-ebd6-49f7-b921-a197625c3518 tempest-VolumesTestJSON-1167068962 tempest-VolumesTestJSON-1167068962-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.103564 Sep 28 15:43:32.621790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 58/109] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 28 15:43:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:33.538523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:33.539143 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:33.545824 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:33.546306 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:33.546753 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.547448 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:33.547887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:33.548387 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.573471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:33.574901 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:33.581448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:33.582187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:33.582664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.583551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:33.583991 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:33.584440 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.717035 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:33.725150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-81ecb011-d0cf-47aa-8252-1843e7e08aa9 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.190420 Sep 28 15:43:33.725714 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 52/110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:33 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:33.779938 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:33.787508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b3a4e535-300d-4382-aac4-ff0944ffae00 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.218189 Sep 28 15:43:33.788063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 59/111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:33 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:34.749186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:34.749919 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:34.756281 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:34.757098 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:34.757593 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:34.758384 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:34.758917 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:34.759407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:34.814649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:34.816022 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:34.836479 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:34.837036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:34.837543 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:34.838321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:34.838865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:34.839353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:35.007784 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:35.016006 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a6081a42-e8e6-4b65-b762-6ef5496bf575 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.271876 Sep 28 15:43:35.020528 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 53/112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:34 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:35.034549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:35.044914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c4673279-428e-45b7-a751-64d86938cc09 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.237555 Sep 28 15:43:35.045819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 60/113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:34 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:36.041359 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:36.041886 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:36.047880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:36.048446 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:36.048786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:36.049463 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:36.049941 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:36.050463 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:36.075093 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:36.076363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:36.082298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:36.082805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:36.083228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:36.083908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:36.084350 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:36.084772 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:36.252516 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:36.257354 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:36.261924 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0309aca0-70d0-4914-a151-6d6ac1d1c489 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.224391 Sep 28 15:43:36.262523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 54/114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:36 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:36.265993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-10f5c95a-fe50-48b0-83a5-66829ae7c2f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.194644 Sep 28 15:43:36.266722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 61/115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:36 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:37.290334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:37.291263 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:37.302293 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:37.303721 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:37.303985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:37.304769 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:37.306946 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:37.308188 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:37.311827 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:37.313408 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:37.333394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:37.334564 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:37.335542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:37.337782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:37.339774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:37.340900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:37.657961 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:37.662814 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:37.669278 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8025b199-bf01-4c5d-8f31-d23824c9618f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.383197 Sep 28 15:43:37.669961 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 55/116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:37 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:37.697062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:37.705514 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6b7a3bdd-7935-448b-8a22-eb5604f338ea tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.418062 Sep 28 15:43:37.706039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 62/117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:37 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:38.696572 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:38.697201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:38.699416 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:38.706237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:38.706755 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:38.707196 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:38.707885 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:38.708491 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:38.709056 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:38.729212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:38.729807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:38.740002 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:38.740525 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:38.740925 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:38.741634 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:38.746758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:38.747248 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:38.986468 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:38.998313 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d8f53f51-9040-4c74-80ae-287ee43c08e0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.304760 Sep 28 15:43:38.999012 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 56/118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:38 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:39.032872 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:39.041304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-451c0410-695a-4ec3-af97-3c525f42d9fe tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.315887 Sep 28 15:43:39.055422 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 63/119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:38 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:39.370081 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-17063422-0d2e-4483-99a7-5d54af0fc962 req-230e55b9-8a64-47e7-a3ff-88f2c8dad522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd97fd33-7baf-4398-98d7-0f5aefb9b3c1", "name": "network-vif-plugged", "status": "completed", "tag": "c76a912a-3995-45da-b353-a6d34615847e"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:39.381350 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-17063422-0d2e-4483-99a7-5d54af0fc962 req-230e55b9-8a64-47e7-a3ff-88f2c8dad522 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:39.381909 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-17063422-0d2e-4483-99a7-5d54af0fc962 req-230e55b9-8a64-47e7-a3ff-88f2c8dad522 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:39.382398 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-17063422-0d2e-4483-99a7-5d54af0fc962 req-230e55b9-8a64-47e7-a3ff-88f2c8dad522 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:39.396581 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-17063422-0d2e-4483-99a7-5d54af0fc962 req-230e55b9-8a64-47e7-a3ff-88f2c8dad522 service nova] Creating event network-vif-plugged:c76a912a-3995-45da-b353-a6d34615847e for instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 on hv-cinder-85931 Sep 28 15:43:39.405272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-17063422-0d2e-4483-99a7-5d54af0fc962 req-230e55b9-8a64-47e7-a3ff-88f2c8dad522 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103105 Sep 28 15:43:39.405903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 57/120] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:40.021809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:40.022532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:40.031017 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:40.031816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:40.032533 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:40.033430 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:40.034218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:40.034879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:40.069693 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:40.071237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:40.082955 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:40.084661 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:40.086514 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:40.088688 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:40.089431 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:40.089908 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:40.496784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:40.506574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-782c97ea-c496-4921-90c6-7048daf5b679 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.489029 Sep 28 15:43:40.506974 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:40.507151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 64/121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:40 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:40.516081 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7106cd03-e28c-4889-9077-ab9a04a714f8 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.451492 Sep 28 15:43:40.521678 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 58/122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:40 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:41.529587 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:41.530286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:41.536474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:41.536986 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:41.537494 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:41.538247 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:41.538782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:41.539205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:41.539296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:41.539390 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:41.545795 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:41.546251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:41.546706 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:41.547401 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:41.547827 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:41.548246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:41.750089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:41.754771 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:41.758717 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-904504f6-0fb4-4d4f-89b4-e605abf3ba82 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.233536 Sep 28 15:43:41.759481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 65/123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:41 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:41.763589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-af822997-99df-4711-9356-00cadc12312c tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.228051 Sep 28 15:43:41.764412 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 59/124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:41 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:42.781059 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:42.781971 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:42.788109 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:42.788593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:42.788716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:42.788848 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:42.789433 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:42.790131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:42.790610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:42.791194 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:42.795850 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:42.796418 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:42.796918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:42.797724 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:42.798238 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:42.798745 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:42.807961 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=100 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:43.015804 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:43.018702 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:43.025131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e9ef80e3-1364-47f1-abb9-1829507b06d9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.248023 Sep 28 15:43:43.025705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 66/125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:42 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:43.027632 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c7661c5f-8397-493f-9098-4e5ac9f613be tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.243851 Sep 28 15:43:43.028277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 60/126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:42 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:44.051899 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:44.052739 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:44.053416 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:44.054680 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:44.059238 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:44.059880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:44.060545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:44.061085 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:44.061369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:44.061562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:44.061976 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:44.062102 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:44.062577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:44.062714 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:44.063134 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:44.063540 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:44.283979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:44.288527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:44.297366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1089af27-163e-4135-983e-838b1b8a477f tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.250332 Sep 28 15:43:44.297946 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 67/127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:44 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:44.304564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-9db8fc71-353e-40b5-aba4-6bc507e953bc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.255125 Sep 28 15:43:44.305746 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 61/128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:44 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:45.323612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:45.326179 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:45.334524 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:45.335121 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:45.339226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:45.340371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:45.341896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:45.343104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:45.344056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:45.344637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:45.356014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:45.357116 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:45.358972 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:45.359997 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:45.361126 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:45.361816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:45.623780 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:45.634728 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-50c6183a-f647-4337-ab11-fb8a23f1b961 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.303922 Sep 28 15:43:45.650851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 62/129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:45 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:45.670516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:45.679099 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2692b164-3b6a-4435-b237-76bedb745afd tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.361736 Sep 28 15:43:45.679670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 68/130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:45 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:46.661859 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:46.662521 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:46.676850 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.677565 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.678738 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.680392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.681144 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.682083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.702537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:46.703795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:46.713736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.714970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.717183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.718802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.720027 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.721177 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:47.083643 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:47.096675 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3e46bba7-8386-4459-9b6b-d3a9690995e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.440718 Sep 28 15:43:47.100666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 63/131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:46 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:47.105271 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:47.118947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9eb29e57-6716-45a5-894c-ec7dabc303ab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.420073 Sep 28 15:43:47.120680 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 69/132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:46 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:47.120922 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-da05c8bc-3252-48fe-bdfe-62ea68e40553 req-ce28a783-9ed5-4ad8-b271-ad0881b260bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cbbb80-d096-4b55-bfd8-417ff2f04c26", "name": "network-vif-plugged", "status": "completed", "tag": "cc793622-d700-461d-abc7-6af34373f544"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:47.133417 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-da05c8bc-3252-48fe-bdfe-62ea68e40553 req-ce28a783-9ed5-4ad8-b271-ad0881b260bc service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:47.134156 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-da05c8bc-3252-48fe-bdfe-62ea68e40553 req-ce28a783-9ed5-4ad8-b271-ad0881b260bc service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:47.134867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-da05c8bc-3252-48fe-bdfe-62ea68e40553 req-ce28a783-9ed5-4ad8-b271-ad0881b260bc service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:47.151568 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-da05c8bc-3252-48fe-bdfe-62ea68e40553 req-ce28a783-9ed5-4ad8-b271-ad0881b260bc service nova] Creating event network-vif-plugged:cc793622-d700-461d-abc7-6af34373f544 for instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 on hv-cinder-85931 Sep 28 15:43:47.172196 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-da05c8bc-3252-48fe-bdfe-62ea68e40553 req-ce28a783-9ed5-4ad8-b271-ad0881b260bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070009 Sep 28 15:43:47.172802 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 64/133] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:48.124188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:48.125782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:48.133854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:48.134436 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:48.135359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:48.136373 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:48.137214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:48.138239 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:48.147593 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:48.148449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:48.154923 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:48.155489 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:48.155826 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:48.156518 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:48.156966 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:48.157385 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:48.392555 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:48.397261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:48.400662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-eb9b4080-a81c-4dbe-b431-a2f70d8e5c7f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.280989 Sep 28 15:43:48.401485 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 70/134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:48 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:48.405596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-816a1b97-8ae3-46b2-be64-d57fc740f783 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1315 microversion: 2.1 time: 0.262198 Sep 28 15:43:48.406147 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 65/135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:48 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:49.435724 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:49.437241 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:49.438552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:49.439357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:49.452673 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.453164 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.453557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.455774 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.457026 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.457452 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.458116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.458831 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.460834 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.462608 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.463085 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.463519 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.739184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:49.749635 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-74862b71-ad72-4d0c-9cea-26ff8e6f1d16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1322 microversion: 2.1 time: 0.327861 Sep 28 15:43:49.750614 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 71/136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:49 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:49.759172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:49.771937 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-56a867f8-4139-49ab-b5bb-ac0e597fbdbc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1501 microversion: 2.1 time: 0.345776 Sep 28 15:43:49.772824 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 66/137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:49 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1501 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:50.779326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:50.779972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:50.800411 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:50.800927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:50.801366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:50.802080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:50.807385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:50.809851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.127292 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:51.135826 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6f0d4b22-ad57-4902-afb0-8b164156e211 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1516 microversion: 2.1 time: 0.366526 Sep 28 15:43:51.137307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 72/138] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:50 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1516 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:51.163399 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:51.165884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:51.172712 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-0209ef17-3cbe-4d2a-952c-f5e34061cdc8 req-c65d0ffe-2744-4b6c-b73b-35662b710907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfd6533-e103-4f9d-905a-d839c4834f77", "name": "network-vif-plugged", "status": "completed", "tag": "b1dc2b46-1b60-48c5-ab08-4ee2cbc934b7"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:51.204148 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.204679 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.205105 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0209ef17-3cbe-4d2a-952c-f5e34061cdc8 req-c65d0ffe-2744-4b6c-b73b-35662b710907 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.205614 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0209ef17-3cbe-4d2a-952c-f5e34061cdc8 req-c65d0ffe-2744-4b6c-b73b-35662b710907 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.208367 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.208903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0209ef17-3cbe-4d2a-952c-f5e34061cdc8 req-c65d0ffe-2744-4b6c-b73b-35662b710907 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.212211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.214235 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.216535 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.257508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-0209ef17-3cbe-4d2a-952c-f5e34061cdc8 req-c65d0ffe-2744-4b6c-b73b-35662b710907 service nova] Creating event network-vif-plugged:b1dc2b46-1b60-48c5-ab08-4ee2cbc934b7 for instance 3cfd6533-e103-4f9d-905a-d839c4834f77 on hv-cinder-85931 Sep 28 15:43:51.281182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-0209ef17-3cbe-4d2a-952c-f5e34061cdc8 req-c65d0ffe-2744-4b6c-b73b-35662b710907 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109725 Sep 28 15:43:51.281871 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 73/139] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:43:51.433889 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lazy-loading 'flavor' on Instance uuid 37cbbb80-d096-4b55-bfd8-417ff2f04c26 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:43:51.480890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6977be25-098a-48ce-a51e-a344dc37cf8c"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:51.484360 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:51.518077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.519126 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.519674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.520658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.521301 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.521818 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.798091 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-017cff72-a2d8-4111-a31b-6580ba69474e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26/action" status: 200 len: 32 microversion: 2.1 time: 0.639264 Sep 28 15:43:51.799093 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 67/140] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:43:51 2022] POST /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26/action => generated 32 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:43:51.828430 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:51.837349 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:51.839488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=52 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:51.851626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.852116 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.853708 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.854730 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.855193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.855595 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:52.134358 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:52.150754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b3eeeb29-9acb-48b4-8b36-ea92f86ffa4b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.344045 Sep 28 15:43:52.166917 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 68/141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:51 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:52.680248 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-be1e07f0-d85c-4a4c-87d1-a9c709820aec tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "POST /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.206557 Sep 28 15:43:52.682045 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 74/142] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 15:43:51 2022] POST /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1/os-volume_attachments => generated 194 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:53.174291 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:53.174851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:53.181678 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:53.182175 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:53.182645 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:53.183608 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:53.184050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:53.184683 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:53.462085 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:53.470812 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-36e07086-6291-48e1-a8e9-a1bcf7394e87 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.300548 Sep 28 15:43:53.471398 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 69/143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:53 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:54.526152 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:54.527339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:54.534926 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=52 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:54.541450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.541972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.542662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.543398 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.545175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.545852 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.806737 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:54.817813 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ed25d574-2dc7-4b83-badb-9fc9c6492fd5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.325345 Sep 28 15:43:54.839545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 75/144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:54 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:55.857521 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:55.859382 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:55.869349 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.869849 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.870654 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.871482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.872692 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.873203 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:56.060773 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:56.069506 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-201165ce-c0d1-4fff-a950-0205ca9c8831 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.216900 Sep 28 15:43:56.070489 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 70/145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:55 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:57.099266 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:57.099948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:57.108377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:57.109308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:57.109742 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:57.110597 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:57.111044 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:57.111567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:57.286020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:57.297261 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a9fd3ad9-a164-4320-ac5a-99c15ad08c16 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.202307 Sep 28 15:43:57.297886 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 76/146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:57 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:58.330626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:58.331334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:58.337436 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:58.337903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:58.338322 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:58.339033 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:58.339468 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:58.339875 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:58.478622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:58.481991 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:58.487760 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d9f23016-1dd8-40f4-9d86-36a4a1e98f1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.160953 Sep 28 15:43:58.488341 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 71/147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:58 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:59.510053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:59.510730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:59.517522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:59.517951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:59.518497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:59.519319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:59.519951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:59.520375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:59.746573 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:59.754915 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-886b3c80-7348-4600-bf10-b8c64e7645ec tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.248677 Sep 28 15:43:59.755570 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 77/148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:59 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:00.783172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:00.783782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:00.790734 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:00.791206 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:00.791638 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:00.792341 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:00.792814 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:00.793698 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:00.946886 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:00.958087 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-35b29de2-70de-49e1-b6ca-0e7b6a34b7ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.179087 Sep 28 15:44:00.959187 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 72/149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:00 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:01.985714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:01.986333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:01.992910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:01.993394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:01.993821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:01.994566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:01.995011 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:01.995431 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.143625 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:02.152376 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4245761a-906b-42a6-806b-149892bd172e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.170507 Sep 28 15:44:02.153108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 78/150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:01 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:03.176556 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:03.177153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:03.183380 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.184338 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.184754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.185420 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.185859 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.186268 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.315580 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:03.323356 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6e76e476-f5ec-4327-a8b7-f66f15dac377 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.150496 Sep 28 15:44:03.323915 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 73/151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:03 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:04.347295 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:04.347924 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:04.355115 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:04.355599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:04.356022 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:04.356720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:04.357154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:04.357562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:04.499303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:04.506929 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4cbcbe5b-ac78-43e2-b0bb-2129fdbd72ca tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.163493 Sep 28 15:44:04.507664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 79/152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:04 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:05.529788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:05.530552 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:05.536801 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.537279 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.537707 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.538403 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.538869 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.539294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.679364 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:05.687296 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e153b206-8ab6-40b6-8224-b7f7e8b5ce52 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.161914 Sep 28 15:44:05.687890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 74/153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:05 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:06.711047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:06.711708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:06.718257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:06.718771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:06.719202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.719892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:06.720343 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:06.720763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.850380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:06.858794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fa49dfd2-c6da-479a-b01a-85f639fdadff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.151515 Sep 28 15:44:06.859365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 80/154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:06 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:07.881089 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:07.881699 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:07.889068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.889566 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.889984 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.890724 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.891176 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.891594 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:08.028886 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:08.036965 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dab58884-67c3-4423-996f-11b824d57ec8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.159635 Sep 28 15:44:08.037719 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 75/155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:07 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:09.060340 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:09.060943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:09.067534 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:09.068001 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:09.068420 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:09.069091 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:09.069527 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:09.069936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:09.197972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:09.206032 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d4564b13-4c37-42fa-a821-1a8c34807f2b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.149716 Sep 28 15:44:09.206636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 81/156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:09 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:10.229006 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:10.229609 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:10.237306 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:10.237782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:10.238214 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:10.238945 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:10.239394 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:10.239813 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:10.388218 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:10.396167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-954bc020-7017-48ad-bd35-19c503d70cbd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.170978 Sep 28 15:44:10.396746 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 76/157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:10 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:11.054405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:11.054992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:11.061567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.062137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.062730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.063582 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.064262 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.064847 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.081110 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:11.093999 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:44:11.195423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7d1cd38f-6b0e-4b7c-9224-6ea853692fab tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 204 len: 0 microversion: 2.1 time: 0.144478 Sep 28 15:44:11.197332 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 82/158] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:44:11 2022] DELETE /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:44:11.206345 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:11.207016 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:11.212900 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.213493 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.213930 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.214662 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.215112 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.215529 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.359538 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:11.367436 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-17394bd2-ab48-44c6-a511-97cb4b8698d5 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1553 microversion: 2.1 time: 0.166185 Sep 28 15:44:11.368019 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 77/159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:11 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:11.419639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:11.420366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:11.426858 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.427335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.427764 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.428442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.428926 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.429459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.609508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:11.621815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a54b3fa2-7458-4e64-a225-685b8594a4ee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.206193 Sep 28 15:44:11.622428 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 83/160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:11 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:12.391672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:12.392205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:12.398113 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:12.398669 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:12.399035 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:12.399900 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:12.400572 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:12.400988 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:12.586179 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:12.599433 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-9d3f1fa2-9161-46d8-bf9d-efeeddf8f428 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1553 microversion: 2.1 time: 0.212003 Sep 28 15:44:12.600159 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 78/161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:12 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:12.649956 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:12.650867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:12.659580 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:12.660071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:12.660507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:12.662859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:12.663318 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:12.663745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:12.924194 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:12.932843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f6697557-f184-4f21-8a5e-261f02005943 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.287868 Sep 28 15:44:12.947586 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 84/162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:12 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:13.624217 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:13.626816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:13.633684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.634203 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.634999 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.635838 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.636469 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.637093 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.846405 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:13.856552 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8b336ced-48cc-4727-9039-d1973f987cd0 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1553 microversion: 2.1 time: 0.236624 Sep 28 15:44:13.858370 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 79/163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:13 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:13.962834 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:13.963809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:13.972469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.972970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.973694 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.974651 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.975112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.975537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:14.182051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:14.191704 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c326a9fd-9812-4636-be8a-5a7060551580 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.233360 Sep 28 15:44:14.194537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 85/164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:13 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:14.855687 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-53b4a443-877e-4ae4-b543-0802e92599ef req-029afd85-8eda-4ba3-8c27-5569c1ce829e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd97fd33-7baf-4398-98d7-0f5aefb9b3c1", "name": "network-vif-deleted", "tag": "c76a912a-3995-45da-b353-a6d34615847e"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:14.869104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-53b4a443-877e-4ae4-b543-0802e92599ef req-029afd85-8eda-4ba3-8c27-5569c1ce829e service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:14.869705 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-53b4a443-877e-4ae4-b543-0802e92599ef req-029afd85-8eda-4ba3-8c27-5569c1ce829e service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:14.870251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-53b4a443-877e-4ae4-b543-0802e92599ef req-029afd85-8eda-4ba3-8c27-5569c1ce829e service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:14.889481 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-53b4a443-877e-4ae4-b543-0802e92599ef req-029afd85-8eda-4ba3-8c27-5569c1ce829e service nova] Creating event network-vif-deleted:c76a912a-3995-45da-b353-a6d34615847e for instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 on hv-cinder-85931 Sep 28 15:44:14.897038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-53b4a443-877e-4ae4-b543-0802e92599ef req-029afd85-8eda-4ba3-8c27-5569c1ce829e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046804 Sep 28 15:44:14.897248 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:14.897847 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:14.898581 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 80/165] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:14.933845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:14.936434 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:14.937030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:14.950684 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:14.952103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:14.952798 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:15.077424 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:15.087536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9fca8234-6621-4c71-9088-fe13cc9e55cb tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1346 microversion: 2.1 time: 0.206314 Sep 28 15:44:15.088577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 86/166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:14 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1346 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:15.217421 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:15.217750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:15.223980 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:15.224530 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:15.225167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:15.226130 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:15.226753 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:15.227225 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:15.375195 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:15.386100 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4e95f1a4-886a-4e3a-8bab-7cb1d8eb4515 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.173217 Sep 28 15:44:15.386902 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 81/167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:15 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:16.112129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:16.112740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:16.120045 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.120545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.120980 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.121677 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.122121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.122647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.158661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.159151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.159580 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.160032 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lazy-loading 'fault' on Instance uuid cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:44:16.204768 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc93ac31604022a522b47559ab31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524d39d780b2426cbacde028e1b061de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:16.213417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2c28bbca-c5a5-46f7-b4ba-ef5934d90a37 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 200 len: 1351 microversion: 2.1 time: 0.105068 Sep 28 15:44:16.213979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 87/168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:16 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:16.410439 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:16.411066 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:16.417394 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.417883 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.418315 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.419042 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.419488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.419948 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.590047 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:16.599023 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3e8749f5-aed1-44a6-a634-8ab43e870f28 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.192460 Sep 28 15:44:16.599694 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 82/169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:16 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:17.242747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:17.243562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:17.267934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.269079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.269758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.271281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.271747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.272220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.287885 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] HTTP exception thrown: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Request method failure captured: Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 HTTP/1.1 Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGt7BevupDbK--bS2s3M7Ip9sy-K1CJ6WakPrBdbg-Sk3TSXSicgvp1G38JfrpAx8IKbhLUHZLTV5ZBCOO3Cv5m00iSRcrDfNZ2YyxqI7ZTFW0TpdIFbVC7ZAufEzliMug9tzfcWQbPJ7XibBD3flUhOVYFLsnkvcnVZoRPfQi934xI Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 524d39d780b2426cbacde028e1b061de Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:44:17.292649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_524d39d780b2426cbacde028e1b061de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524d39d780b2426cbacde028e1b061de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524d39d780b2426cbacde028e1b061de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/524d39d780b2426cbacde028e1b061de"}]}] Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 524d39d780b2426cbacde028e1b061de Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-DeleteServersTestJSON-1167587900-project Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 76dc93ac31604022a522b47559ab31b5 Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-DeleteServersTestJSON-1167587900-project Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.293914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'cd97fd33-7baf-4398-98d7-0f5aefb9b3c1'} Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:44:17.294698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.295827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.296842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Returning 404 to user: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:44:17.296842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8ad1b5a8-6e83-4829-81b1-9a304baf1445 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 404 len: 111 microversion: 2.1 time: 0.055305 Sep 28 15:44:17.296842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 88/170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:17 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:44:17.437139 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:17.439378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:17.445150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.445635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.446051 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.446916 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.447554 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.448114 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.461996 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] HTTP exception thrown: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Request method failure captured: Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1/os-volume_attachments HTTP/1.1 Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGt7BevupDbK--bS2s3M7Ip9sy-K1CJ6WakPrBdbg-Sk3TSXSicgvp1G38JfrpAx8IKbhLUHZLTV5ZBCOO3Cv5m00iSRcrDfNZ2YyxqI7ZTFW0TpdIFbVC7ZAufEzliMug9tzfcWQbPJ7XibBD3flUhOVYFLsnkvcnVZoRPfQi934xI Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 524d39d780b2426cbacde028e1b061de Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:44:17.466700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_524d39d780b2426cbacde028e1b061de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524d39d780b2426cbacde028e1b061de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524d39d780b2426cbacde028e1b061de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/524d39d780b2426cbacde028e1b061de"}]}] Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 524d39d780b2426cbacde028e1b061de Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-DeleteServersTestJSON-1167587900-project Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 76dc93ac31604022a522b47559ab31b5 Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-DeleteServersTestJSON-1167587900-project Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: > Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.468252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'server_id': 'cd97fd33-7baf-4398-98d7-0f5aefb9b3c1'} Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:44:17.469191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:17.470606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:17.472194 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Returning 404 to user: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:44:17.472194 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dac8b6ed-f9a1-4008-a6d9-f27e4a4865f3 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035645 Sep 28 15:44:17.472194 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 83/171] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:44:17 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:44:17.625098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:17.625877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:17.633511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.634245 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.634699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.637021 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.637656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.638758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.788967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:17.796870 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d2585117-5d42-4aff-949f-a2231589880d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.179148 Sep 28 15:44:17.797497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 89/172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:17 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:18.820445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:18.822247 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:18.829199 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:18.829683 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:18.830107 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:18.831031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:18.831495 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:18.832140 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.017588 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:19.025840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-58d67560-bb49-4bd4-bd51-23e10f8d615f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.208751 Sep 28 15:44:19.026635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 84/173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:18 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:19.797815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:19.798479 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:19.804836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.805324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.805900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.806723 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.807175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.807762 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.822064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] HTTP exception thrown: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Request method failure captured: Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 HTTP/1.1 Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGt7BevupDbK--bS2s3M7Ip9sy-K1CJ6WakPrBdbg-Sk3TSXSicgvp1G38JfrpAx8IKbhLUHZLTV5ZBCOO3Cv5m00iSRcrDfNZ2YyxqI7ZTFW0TpdIFbVC7ZAufEzliMug9tzfcWQbPJ7XibBD3flUhOVYFLsnkvcnVZoRPfQi934xI Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 524d39d780b2426cbacde028e1b061de Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:44:19.823747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_524d39d780b2426cbacde028e1b061de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524d39d780b2426cbacde028e1b061de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524d39d780b2426cbacde028e1b061de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/524d39d780b2426cbacde028e1b061de"}]}] Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 524d39d780b2426cbacde028e1b061de Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-DeleteServersTestJSON-1167587900-project Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 76dc93ac31604022a522b47559ab31b5 Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-DeleteServersTestJSON-1167587900-project Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.825135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'cd97fd33-7baf-4398-98d7-0f5aefb9b3c1'} Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:44:19.825994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.827296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.828595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Returning 404 to user: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:44:19.828595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3aa34913-cb3b-4c04-8265-5e51c30c4327 tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 404 len: 111 microversion: 2.1 time: 0.033445 Sep 28 15:44:19.832087 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 90/174] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:44:19 2022] DELETE /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:44:19.837829 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:19.838828 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] [instance: cd97fd33-7baf-4398-98d7-0f5aefb9b3c1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:19.845816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.846300 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.847847 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.848448 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.848906 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.849324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.866373 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] HTTP exception thrown: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Request method failure captured: Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 HTTP/1.1 Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGt7BevupDbK--bS2s3M7Ip9sy-K1CJ6WakPrBdbg-Sk3TSXSicgvp1G38JfrpAx8IKbhLUHZLTV5ZBCOO3Cv5m00iSRcrDfNZ2YyxqI7ZTFW0TpdIFbVC7ZAufEzliMug9tzfcWQbPJ7XibBD3flUhOVYFLsnkvcnVZoRPfQi934xI Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 524d39d780b2426cbacde028e1b061de Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:44:19.868985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_524d39d780b2426cbacde028e1b061de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524d39d780b2426cbacde028e1b061de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524d39d780b2426cbacde028e1b061de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/524d39d780b2426cbacde028e1b061de"}]}] Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 524d39d780b2426cbacde028e1b061de Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-DeleteServersTestJSON-1167587900 Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-DeleteServersTestJSON-1167587900-project Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 76dc93ac31604022a522b47559ab31b5 Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-DeleteServersTestJSON-1167587900-project Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: > Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.870458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'id': 'cd97fd33-7baf-4398-98d7-0f5aefb9b3c1'} Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:44:19.871587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. Sep 28 15:44:19.876579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:44:19.878592 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] Returning 404 to user: Instance cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 could not be found. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:44:19.878592 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-55a44d50-1221-43e3-bd1d-80caabfb67dc tempest-DeleteServersTestJSON-1167587900 tempest-DeleteServersTestJSON-1167587900-project] 10.222.0.60 "GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1" status: 404 len: 111 microversion: 2.1 time: 0.037047 Sep 28 15:44:19.878592 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 85/175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:19 2022] GET /compute/v2.1/servers/cd97fd33-7baf-4398-98d7-0f5aefb9b3c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:44:20.051019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:20.051819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:20.059903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.060528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.061056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.062168 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.063106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.063572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.337737 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:20.346645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9f4d995f-101e-435a-801a-73ef2c0c2945 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.300792 Sep 28 15:44:20.347193 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 91/176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:20 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:21.377658 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:21.378185 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:21.384422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:21.384899 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:21.385328 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:21.386013 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:21.386499 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:21.386905 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:21.768903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:21.776501 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-993e7ccb-6830-4098-96a5-6883b53b2be3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.402888 Sep 28 15:44:21.777060 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 86/177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:21 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:22.800323 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:22.800924 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:22.810759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:22.811254 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:22.811676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:22.812377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:22.813879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:22.814442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:22.996286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:23.005122 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-975a3a20-5bfc-4eb4-8e5d-350c73addab3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.208837 Sep 28 15:44:23.005627 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 92/178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:22 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:24.027499 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:24.028108 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:24.031578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=38 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:24.037654 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:24.038217 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:24.038672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:24.039428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:24.039876 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:24.040328 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:24.187437 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:24.194954 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-985e94c2-c97b-4828-b0b0-36f49a654423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.171208 Sep 28 15:44:24.195516 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 87/179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:24 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:25.218746 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:25.220588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:25.223145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:25.228074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:25.228561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:25.228995 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:25.229683 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:25.230158 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:25.230794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:25.463258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:25.482749 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d33703e4-c48f-43ee-ac72-cb6e43562cb7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.267794 Sep 28 15:44:25.483334 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 93/180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:25 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:26.525036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:26.525653 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:26.532693 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:26.533177 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:26.533608 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:26.534298 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:26.534791 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:26.535206 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:26.831941 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:26.842251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6d83455e-7f60-463a-9913-4f775ed7dfa7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.330744 Sep 28 15:44:26.842835 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 88/181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:26 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:27.866733 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:27.867349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:27.885074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:27.885984 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:27.886672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:27.888590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:27.892287 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:27.893457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:28.162538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:28.174448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-419404e3-eba3-40d4-bc75-eda5f974274f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.313020 Sep 28 15:44:28.176134 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 94/182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:27 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:29.199732 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:29.200869 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:29.210173 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:29.214972 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:29.215460 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:29.216763 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:29.217259 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:29.217736 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:29.513712 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:29.523221 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c67f42e3-df64-4a2e-a617-4087a2db6b0b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.328085 Sep 28 15:44:29.524872 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 89/183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:29 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:30.066243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-af2a1261-fd3d-4c08-a07b-6fb867c1d2d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'create', calling method: .version_select at 0x7f8fcfd64940>, body: {"keypair": {"name": "tempest-keypair-1682306247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx7WRWzf66d9Ao9s0niWnk/RGORnKlcqwbvKVQGttkU0wqeBe7J5bGoLSszn0QWQAW0Fw0TQEQZ2ErX+1eP+BMd5H0otBgwsIvNBK3Pyt29PC+Vwur8X4/oC9A8cyUjPA=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:30.101337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-af2a1261-fd3d-4c08-a07b-6fb867c1d2d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Getting quotas for project c7541b0dd8b14bf495094ddaa132bc2a. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:44:30.105601 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-af2a1261-fd3d-4c08-a07b-6fb867c1d2d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Getting quotas for user 9ecdfa3c79f84cc29061dd5ebfa60101 and project c7541b0dd8b14bf495094ddaa132bc2a. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:44:30.176511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-af2a1261-fd3d-4c08-a07b-6fb867c1d2d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.380930 Sep 28 15:44:30.177178 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 95/184] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 28 15:44:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 383 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 15:44:30.553078 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:30.553688 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:30.563716 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:30.564694 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:30.565456 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:30.566504 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:30.567093 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:30.567726 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:30.610610 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:30.854559 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:30.864592 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-2eac97d4-9ca0-4afe-85c1-5b0e3c815b46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.315414 Sep 28 15:44:30.865597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 90/185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:30 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:31.895550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:31.897349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:31.910280 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:31.916180 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:31.917184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:31.921153 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:31.921955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:31.922856 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:32.229322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:32.254345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-80d83318-2fdc-498c-896e-ff8e702c11b0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.350717 Sep 28 15:44:32.262622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 96/186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:31 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:32.489663 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2143916746", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a084e51-a246-4b59-8959-18fe57f781ea"}], "security_groups": [{"name": "tempest-securitygroup--321792948"}], "key_name": "tempest-keypair-1682306247", "user_data": "}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:32.626305 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] validate_networks() for [('1a084e51-a246-4b59-8959-18fe57f781ea', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:44:33.186250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:44:33.186700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:44:33.190512 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:44:33.190991 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:44:33.191362 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:44:33.212276 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:33.212974 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:33.213166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:33.213900 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:33.214350 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:33.214835 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:33.273905 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Getting quotas for project c7541b0dd8b14bf495094ddaa132bc2a. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:44:33.278709 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Getting quotas for user 9ecdfa3c79f84cc29061dd5ebfa60101 and project c7541b0dd8b14bf495094ddaa132bc2a. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:44:33.288210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:33.288919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:33.302898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:33.303387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:33.306929 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:33.307422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:44:33.311332 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:33.311847 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:44:33.312148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:33.313010 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:33.368414 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-35322341-6365-447a-8e67-c9556b940465 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.882987 Sep 28 15:44:33.369942 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 91/187] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 28 15:44:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 15:44:33.393144 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2930db7e-889a-42ef-9b06-395cb327dc3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:33.393331 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-2930db7e-889a-42ef-9b06-395cb327dc3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:33.496601 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2930db7e-889a-42ef-9b06-395cb327dc3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:33.514605 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2930db7e-889a-42ef-9b06-395cb327dc3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:33.520906 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2930db7e-889a-42ef-9b06-395cb327dc3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:33.522289 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-2930db7e-889a-42ef-9b06-395cb327dc3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1282 microversion: 2.20 time: 0.144847 Sep 28 15:44:33.523783 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 92/188] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:33 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:33.605196 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:33.618183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1d34734c-50c6-440c-8646-395baad3ccbb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.334406 Sep 28 15:44:33.618781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 97/189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:33 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:34.551357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:34.552092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:34.560065 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:34.560550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:34.561115 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:34.561819 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:34.562263 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:34.562707 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:34.631569 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:34.644589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:34.645286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:34.646487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:34.647974 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:34.649642 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4bb7a74a-fde0-4622-b398-17868f345a19 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1334 microversion: 2.20 time: 0.105920 Sep 28 15:44:34.654254 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:34.655052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:34.655650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:34.656494 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:34.657077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:34.657377 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 93/190] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:34 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1334 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:34.657662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:34.836143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:34.846730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-658e8d49-e77e-453b-97b6-f31ab0310dcf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.203903 Sep 28 15:44:34.850096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 98/191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:34 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:35.679562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:35.680190 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:35.687287 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:35.687759 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:35.688243 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:35.688867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:35.689320 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:35.689741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:35.753237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:35.762207 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:35.763887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:35.765204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4437930e-1747-4d60-8ddb-07d37c987a3e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1342 microversion: 2.20 time: 0.090038 Sep 28 15:44:35.766257 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 94/192] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:35 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:35.872759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:35.873448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:35.880057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:35.880619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:35.881125 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:35.881857 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:35.882296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:35.882733 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:35.899055 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:36.033836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:36.046151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-52348c29-b9f7-4379-ba82-d1c48c7afabb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.177784 Sep 28 15:44:36.046766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 99/193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:35 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:36.790903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:36.791684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:36.799114 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:36.799783 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:36.800468 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:36.801325 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:36.802069 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:36.802729 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:36.893273 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:36.908192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:36.909767 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:36.910970 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d25bb3b0-7f6d-4d0e-b507-23d0fe15a0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1340 microversion: 2.20 time: 0.124635 Sep 28 15:44:36.928305 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 95/194] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:36 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1340 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:37.070387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:37.071074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:37.078138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:37.078665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:37.079202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:37.079943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:37.080574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:37.080996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:37.270641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:37.279595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-60daa5e6-8e3f-4f7b-b2b8-75b0d273e5f2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.213500 Sep 28 15:44:37.280314 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 100/195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:37 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:37.942738 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:37.944117 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:37.951207 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:37.951692 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:37.952137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:37.952819 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:37.953258 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:37.953853 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:38.105040 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:38.113301 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:38.114755 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:38.115840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dfe73afd-ae57-4562-9d76-dd43bca30bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.178163 Sep 28 15:44:38.116391 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 96/196] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:37 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:44:38.303185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:38.303940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:38.310936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:38.311408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:38.311836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:38.312509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:38.312945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:38.313353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:38.447427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:38.455852 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9a56d2b7-92bf-4029-83cd-b22ac02a1acc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.156394 Sep 28 15:44:38.461473 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 101/197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:38 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:39.140568 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:39.141365 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:39.147896 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:39.150453 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:39.150907 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:39.151621 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:39.152273 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:39.152649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:39.478830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:39.479427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:39.486289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:39.486806 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:39.487233 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:39.487921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:39.488365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:39.488779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:39.545231 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:39.554050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:39.555608 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:39.556771 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c6e27bba-f9d2-40c0-81a2-43c51ec3fd6a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.420060 Sep 28 15:44:39.557404 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 97/198] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:39 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:39.670736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:39.679721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7e20ab97-b43f-4945-a879-f42656631f47 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.204417 Sep 28 15:44:39.694972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 102/199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:39 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:40.583459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:40.584013 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:40.595965 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:40.596796 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:40.597422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:40.598454 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:40.599459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:40.599459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:40.703642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:40.704258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:40.706208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:40.712283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:40.712845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:40.713362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:40.714124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:40.714712 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:40.715141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:40.893669 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:40.902394 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:40.907003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:40.908246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a74b5987-9ee9-451a-aa16-801cb2bb9b40 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.328812 Sep 28 15:44:40.909100 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 98/200] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:40 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:44:40.986822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:40.998176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0895b9cb-43b1-44b1-97da-92d6f8353ea3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.298443 Sep 28 15:44:40.998820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 103/201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:40 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:41.933649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:41.935239 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:41.941435 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:41.941920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:41.942358 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:41.943094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:41.943564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:41.943982 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:42.021189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:42.021805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:42.029721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:42.030209 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:42.030878 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:42.031590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:42.032037 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:42.032650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:42.533201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:42.554484 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:42.560068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:42.561884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-57bc3972-1ccc-42cc-bed9-dac895f4707c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.632354 Sep 28 15:44:42.562750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 99/202] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:41 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:42.575396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:42.594831 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c4d118a1-3e49-47f6-985d-1c6513799620 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1522 microversion: 2.1 time: 0.577264 Sep 28 15:44:42.595911 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 104/203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:42 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:43.592017 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:43.594161 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:43.601657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:43.602940 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=8 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:43.605511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:43.608045 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:43.608826 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:43.610067 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:43.611438 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:43.612211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:43.622585 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:43.623450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:43.644220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:43.646758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:43.648060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:43.648942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:43.650962 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:43.651615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:44.209779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:44.219164 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0715c000-da44-4333-b4e7-b2a5cbaadb64 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1502 microversion: 2.1 time: 0.603624 Sep 28 15:44:44.224884 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 105/204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:43 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1502 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:44.256168 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:44.256787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:44.268067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:44.268567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:44.268999 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:44.269698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:44.270773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:44.273586 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:44.288224 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:44.301615 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:44.304489 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:44.306946 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f3de617f-f6c3-4a84-bc5c-254a3359f314 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.719802 Sep 28 15:44:44.310103 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 100/205] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:43 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:44.323170 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-97dc7da6-cd9a-4752-8e47-0c04ff447af6 req-b2721c9f-8462-4df7-bcfd-15b2484a833a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b859de-bccb-472f-ab94-ede851f23b9a", "tag": "e54cc8ad-2191-4813-9924-f40b092980cc"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:44.370305 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-97dc7da6-cd9a-4752-8e47-0c04ff447af6 req-b2721c9f-8462-4df7-bcfd-15b2484a833a service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:44.370773 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-97dc7da6-cd9a-4752-8e47-0c04ff447af6 req-b2721c9f-8462-4df7-bcfd-15b2484a833a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:44.372479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-97dc7da6-cd9a-4752-8e47-0c04ff447af6 req-b2721c9f-8462-4df7-bcfd-15b2484a833a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:44.436511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-97dc7da6-cd9a-4752-8e47-0c04ff447af6 req-b2721c9f-8462-4df7-bcfd-15b2484a833a service nova] Creating event network-changed:e54cc8ad-2191-4813-9924-f40b092980cc for instance e1b859de-bccb-472f-ab94-ede851f23b9a on hv-cinder-85931 Sep 28 15:44:44.445791 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-97dc7da6-cd9a-4752-8e47-0c04ff447af6 req-b2721c9f-8462-4df7-bcfd-15b2484a833a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129535 Sep 28 15:44:44.446401 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 101/206] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:44:44.856909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:44.876117 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d8cefd59-3ade-4c96-bf25-38b4e067e8f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1516 microversion: 2.1 time: 0.621136 Sep 28 15:44:44.877180 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 106/207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:44 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1516 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:45.338533 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:45.339928 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:45.358136 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:45.358915 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:45.359560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:45.360426 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:45.361026 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:45.361592 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:45.907649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:45.919806 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:45.924069 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:45.925647 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c34515df-db01-422c-b1dd-4ed197d0b0be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.591585 Sep 28 15:44:45.927338 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 102/208] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:45 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:46.953039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:46.953657 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:46.968911 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:46.969422 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:46.972377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:46.973170 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:46.973635 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:46.975600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:47.216880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:47.231444 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:47.235484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:47.239808 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dd6a08fe-4bbf-4557-9dd4-77b08f78d6d5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.290165 Sep 28 15:44:47.254636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 107/209] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:46 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:47.747981 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:47.749979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:47.775650 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:47.776084 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:47.776881 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:47.778298 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:47.779954 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:47.780714 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:47.831760 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lazy-loading 'flavor' on Instance uuid 3cfd6533-e103-4f9d-905a-d839c4834f77 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:44:48.077803 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3e6eb058-7709-4b45-89a8-077f01f5891d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77/action" status: 200 len: 32 microversion: 2.1 time: 0.335509 Sep 28 15:44:48.079859 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 103/210] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:44:47 2022] POST /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77/action => generated 32 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:44:48.089241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:48.092289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:48.104141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:48.106345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:48.109319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:48.110494 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:48.112289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:48.112920 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:48.272717 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:48.273468 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:48.290365 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:48.292064 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:48.292654 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:48.295630 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:48.296903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:48.299991 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:48.413599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:48.436065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-144b5817-8f94-4b5c-b1a8-871f90618a1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.351909 Sep 28 15:44:48.437523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 108/211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:48 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:48.633064 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:48.651320 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:48.657091 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:48.660043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-23abb7f0-5d4c-4c67-bf1b-cfa2e12cb011 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.391217 Sep 28 15:44:48.661859 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 104/212] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:48 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:49.459571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:49.460845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:49.471129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:49.471976 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:49.473420 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:49.475269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:49.477994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:49.478573 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:49.716641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:49.717259 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:49.748057 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:49.763131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:49.763673 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:49.764513 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:49.765455 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:49.765958 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:50.323415 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:50.334665 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:50.336316 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:50.337812 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8367ea31-ba43-47a5-821b-13fbbbeec50e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.641563 Sep 28 15:44:50.338663 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 105/213] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:49 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:50.451076 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:50.466729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-aaac5963-13d2-4894-8470-dc004973e836 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 1.010021 Sep 28 15:44:50.468902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 109/214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:49 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:51.366908 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:51.367383 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:51.378202 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:51.379003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:51.379640 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:51.382030 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:51.382713 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:51.383299 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:51.497603 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:51.498872 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:51.507998 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:51.508784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:51.509393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:51.510335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:51.511183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:51.511964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:52.047008 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:52.058506 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:52.063261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:52.069986 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-203f59d7-1a2c-48a9-bebb-fca1be0f99c7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.708243 Sep 28 15:44:52.083618 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 106/215] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:51 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:52.252050 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:52.262552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c4785c2f-487b-4c00-bed7-1733a269c423 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.770224 Sep 28 15:44:52.268006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 110/216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:51 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:53.061863 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-1211333a-3dd3-4d36-a5fa-41009c7e3d12 req-47f9f47b-8b40-4302-b35f-476e3868d149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b859de-bccb-472f-ab94-ede851f23b9a", "name": "network-vif-plugged", "status": "completed", "tag": "e54cc8ad-2191-4813-9924-f40b092980cc"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:53.081802 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-1211333a-3dd3-4d36-a5fa-41009c7e3d12 req-47f9f47b-8b40-4302-b35f-476e3868d149 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:53.083764 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-1211333a-3dd3-4d36-a5fa-41009c7e3d12 req-47f9f47b-8b40-4302-b35f-476e3868d149 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:53.084205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-1211333a-3dd3-4d36-a5fa-41009c7e3d12 req-47f9f47b-8b40-4302-b35f-476e3868d149 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:53.101347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:53.104700 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:53.115381 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-1211333a-3dd3-4d36-a5fa-41009c7e3d12 req-47f9f47b-8b40-4302-b35f-476e3868d149 service nova] Creating event network-vif-plugged:e54cc8ad-2191-4813-9924-f40b092980cc for instance e1b859de-bccb-472f-ab94-ede851f23b9a on hv-cinder-85931 Sep 28 15:44:53.118066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:53.123467 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:53.124132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:53.124898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:53.125667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:53.126187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:53.127462 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-1211333a-3dd3-4d36-a5fa-41009c7e3d12 req-47f9f47b-8b40-4302-b35f-476e3868d149 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075755 Sep 28 15:44:53.128000 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 107/217] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:44:53.298813 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:53.300065 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:53.310505 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:53.312556 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:53.313775 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:53.315261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:53.317470 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:53.318309 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:53.353841 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:53.554455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:53.565514 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:53.567341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:53.568474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c1d341cb-207c-4a0d-bc37-97151f08117c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.475586 Sep 28 15:44:53.569198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 111/218] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:53 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:53.588006 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:53.599697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-08adddd1-0b43-4b84-b542-9bca261549ea tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.309130 Sep 28 15:44:53.600890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 108/219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:53 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:54.323451 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c093f985-3d44-48a5-b7a5-fc1390f8601e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Action: 'create', calling method: .version_select at 0x7f8fcfd654c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1124873369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOwcylBUv9hlyDkvE+akLN/7BvluaXHdu04proeqvKmrAI3oAQt6b7cuvlpzW2bUbqCvutPLIFqigA+bqTb+j1x4sQR4CDU0mhh5J7oHOQ405mxPVFm0BVq6ThBEUg8wg=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:54.344174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-c093f985-3d44-48a5-b7a5-fc1390f8601e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Getting quotas for project b62283fd6a124de0a32ad8f586cf997e. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:44:54.348603 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-c093f985-3d44-48a5-b7a5-fc1390f8601e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Getting quotas for user 0ca903cc98a24621b7c3be488e3e7c5e and project b62283fd6a124de0a32ad8f586cf997e. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:44:54.396666 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c093f985-3d44-48a5-b7a5-fc1390f8601e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.279021 Sep 28 15:44:54.406711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 112/220] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 15:44:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:54.609564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:54.610209 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:54.614133 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:54.628203 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:54.629184 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:54.630167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:54.631078 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:54.631681 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:54.632266 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:54.634324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:54.635516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:54.657193 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:54.658465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:54.659308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:54.660897 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:54.661936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:54.663027 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:54.866884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:54.877185 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:54.879008 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:54.886183 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7a9e6001-2ae7-4a44-92f4-dc1047689e43 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.295812 Sep 28 15:44:54.886951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 109/221] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:54 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:54.968628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:54.986773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8172f365-2dc7-46d6-9ce1-eea252dfe90c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.366211 Sep 28 15:44:54.987653 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 113/222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:54 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:55.679548 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1791280013", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "networks": [{"uuid": "cb563d42-0f77-4789-bc2c-f006c85db118"}]}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:55.746357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] validate_networks() for [('cb563d42-0f77-4789-bc2c-f006c85db118', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:44:55.913851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:55.914486 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:55.917135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:55.946790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:55.947285 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:55.948949 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:55.951332 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:55.951854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:55.952345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:56.285893 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:56.294772 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:56.296229 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:56.297341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fd38df04-9241-496d-9e18-08f297fd96dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1407 microversion: 2.20 time: 0.388716 Sep 28 15:44:56.298138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 114/223] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:55 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:44:56.315805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:56.316416 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:56.330128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:56.331244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:56.331677 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:56.332460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:56.332932 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:56.333339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:56.435622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:44:56.436831 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:44:56.438034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:44:56.439038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:44:56.439674 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:44:56.454271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:56.455134 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:56.455772 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:56.456665 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:56.457271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:56.458278 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:56.482481 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Getting quotas for project ff0f334384454c7daba615e52ce21cd1. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:44:56.486595 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Getting quotas for user b0da6e03372642b8b2ee06780cd03714 and project ff0f334384454c7daba615e52ce21cd1. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:44:56.499827 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:44:56.502543 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:44:56.582171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:56.593274 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a3849af6-c6d6-44bb-bca7-1c3c6a32e426 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.293845 Sep 28 15:44:56.595488 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 115/224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:56 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:56.614589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6f6e6a7d-3027-4bc4-b3ca-30652e58f169 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939782 Sep 28 15:44:56.621360 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 110/225] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:44:56.641251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a7a16aec-afdb-4ee4-9397-9875674a84cf tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:56.641855 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a7a16aec-afdb-4ee4-9397-9875674a84cf tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:56.756114 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a7a16aec-afdb-4ee4-9397-9875674a84cf tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:56.763908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a7a16aec-afdb-4ee4-9397-9875674a84cf tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1214 microversion: 2.1 time: 0.141087 Sep 28 15:44:56.766714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 116/226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:56 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:57.332891 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:57.333659 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:57.342697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.343348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.343892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.345045 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.347445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.348077 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.544936 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:57.556676 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:57.560192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:57.561599 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e27c04a3-8463-43a9-b095-80f324a21778 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1599 microversion: 2.20 time: 0.237568 Sep 28 15:44:57.562281 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 111/227] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:57 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1599 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:57.586903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:57.587474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:57.595182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.595668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.596101 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.596802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.597250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.597914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.627430 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:57.628082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:57.646452 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.649825 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.650275 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.651053 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.655933 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.656417 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.767286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4cc8e084-8aa7-4c94-98e9-aa2f50bc92eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.184464 Sep 28 15:44:57.767878 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 117/228] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 28 15:44:57 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:44:57.799719 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:57.801827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:57.816388 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.818954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.819497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.821905 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.824779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.827889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.867551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=100 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:57.950089 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:57.963547 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b7766956-c926-43a8-9fa8-30890ddece21 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.344239 Sep 28 15:44:57.964425 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 112/229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:57 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:57.982645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:57.993300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8af9e4df-6c6c-499f-a5d4-c861cf52f75f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1266 microversion: 2.1 time: 0.207464 Sep 28 15:44:57.993892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 118/230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:57 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:58.991099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:58.992041 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:58.998816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:58.999314 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:58.999734 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:59.000694 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:59.001133 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:59.001551 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:59.021085 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:59.024242 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:59.034714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:59.035451 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:59.036041 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:59.047386 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:59.048308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:59.052363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:59.186051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:59.198287 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-92d23aee-885b-4464-8a82-376eb05d04f0 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1266 microversion: 2.1 time: 0.182800 Sep 28 15:44:59.200457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 119/231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:59 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:59.229614 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:59.238080 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-eba68c3c-02e3-45cb-a900-cd685347ffb4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.251209 Sep 28 15:44:59.238693 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 113/232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:58 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:59.447370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-b38cf406-f8b5-49a9-b2f1-93a020984745 req-b518b7e5-7e3a-4ff9-b579-bfacba35fd5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b859de-bccb-472f-ab94-ede851f23b9a", "tag": "e54cc8ad-2191-4813-9924-f40b092980cc"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:59.468784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b38cf406-f8b5-49a9-b2f1-93a020984745 req-b518b7e5-7e3a-4ff9-b579-bfacba35fd5a service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:59.469612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b38cf406-f8b5-49a9-b2f1-93a020984745 req-b518b7e5-7e3a-4ff9-b579-bfacba35fd5a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:59.470259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b38cf406-f8b5-49a9-b2f1-93a020984745 req-b518b7e5-7e3a-4ff9-b579-bfacba35fd5a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:59.483972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-b38cf406-f8b5-49a9-b2f1-93a020984745 req-b518b7e5-7e3a-4ff9-b579-bfacba35fd5a service nova] Creating event network-changed:e54cc8ad-2191-4813-9924-f40b092980cc for instance e1b859de-bccb-472f-ab94-ede851f23b9a on hv-cinder-85931 Sep 28 15:44:59.489522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-b38cf406-f8b5-49a9-b2f1-93a020984745 req-b518b7e5-7e3a-4ff9-b579-bfacba35fd5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045816 Sep 28 15:44:59.490246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 120/233] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:00.226786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:00.227996 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:00.235943 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:00.236662 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:00.237268 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:00.238445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:00.239751 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:00.240578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:00.278326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:00.279067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:00.287344 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:00.287832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:00.288267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:00.288963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:00.289411 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:00.289829 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:00.326043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:00.335326 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-eb913f91-3379-4188-84de-44f143e59c40 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1266 microversion: 2.1 time: 0.115987 Sep 28 15:45:00.335920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 114/234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:00 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:00.452002 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:00.460326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fe45032d-81f3-4304-ab2d-ce37cc5ca4c0 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.190310 Sep 28 15:45:00.460908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 121/235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:00 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:01.360756 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:01.361422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:01.367564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:01.368048 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:01.368481 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:01.369171 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:01.369622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:01.370038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:01.435292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:01.443325 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-eb934778-a18a-4937-81f8-b29d60757e36 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1266 microversion: 2.1 time: 0.086401 Sep 28 15:45:01.443900 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 115/236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:01 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:01.483955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:01.484567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:01.491034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:01.491507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:01.491933 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:01.492665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:01.493109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:01.493525 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:01.630151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:01.638498 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-df8d133d-ceb2-45a8-8faf-f55af33e30e4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.158384 Sep 28 15:45:01.639063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 122/237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:01 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:02.466474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:02.467081 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:02.473055 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:02.473531 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:02.473963 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:02.474669 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:02.475119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:02.475537 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:02.537187 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:02.545445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cc01d737-b5ad-4769-8e0f-baf26144998b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1266 microversion: 2.1 time: 0.083411 Sep 28 15:45:02.546003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 116/238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:02 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:02.661026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:02.661635 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:02.668096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:02.668575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:02.669006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:02.669691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:02.670135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:02.670585 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:02.811049 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:02.818706 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-293e26da-cef0-4b1c-9504-a36c25f230f3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.161543 Sep 28 15:45:02.819274 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 123/239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:02 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:03.568366 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:03.568970 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:03.575530 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:03.576011 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:03.576430 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:03.577111 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:03.577551 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:03.577965 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:03.843359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:03.844100 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:03.850698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:03.851186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:03.851618 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:03.852315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:03.852764 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:03.853182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:03.903258 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:03.911250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5f953fbb-acba-4d3c-9546-3ae472db63b5 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1272 microversion: 2.1 time: 0.346810 Sep 28 15:45:03.911912 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 117/240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:03 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:04.094661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:04.102359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3ea29ef6-0cbe-434a-bf71-c4a6ad75afe4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.263515 Sep 28 15:45:04.102956 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 124/241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:03 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:04.936432 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:04.937035 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:04.942955 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:04.943422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:04.943845 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:04.944515 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:04.944947 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:04.945356 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:05.074562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:05.082034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-88630ba4-1317-4420-9f24-4f75817ef2ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.150318 Sep 28 15:45:05.082625 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 118/242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:04 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:05.126647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:05.127252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:05.133697 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:05.134172 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:05.134644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:05.135319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:05.135763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:05.136242 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:05.268384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:05.276378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-79e3787a-b9c3-4ecd-955c-2d0059aa2432 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.153439 Sep 28 15:45:05.277429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 125/243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:05 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:06.104296 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:06.104914 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:06.111165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:06.111676 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:06.112106 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:06.112840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:06.113317 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:06.113737 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:06.300664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:06.302258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:06.310870 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:06.312096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:06.312800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:06.313681 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:06.315405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:06.317153 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:06.326566 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:06.341607 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-77561249-55b5-4781-b925-0af8da699813 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.240907 Sep 28 15:45:06.342618 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 119/244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:06 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:06.359005 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-5700afcd-a8c5-409c-a5ed-ee0ed2826dd9 req-3abf97b5-1ebb-419f-8aa1-82869349d31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88fa7624-3d5a-4557-a626-2b59a4473ba1", "tag": "a98ebd64-b1d9-409e-bb19-39c43a8d9562"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:06.371329 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-5700afcd-a8c5-409c-a5ed-ee0ed2826dd9 req-3abf97b5-1ebb-419f-8aa1-82869349d31e service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:06.371904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-5700afcd-a8c5-409c-a5ed-ee0ed2826dd9 req-3abf97b5-1ebb-419f-8aa1-82869349d31e service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:06.372429 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-5700afcd-a8c5-409c-a5ed-ee0ed2826dd9 req-3abf97b5-1ebb-419f-8aa1-82869349d31e service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:06.384350 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-5700afcd-a8c5-409c-a5ed-ee0ed2826dd9 req-3abf97b5-1ebb-419f-8aa1-82869349d31e service nova] Creating event network-changed:a98ebd64-b1d9-409e-bb19-39c43a8d9562 for instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 on hv-cinder-85931 Sep 28 15:45:06.391378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-5700afcd-a8c5-409c-a5ed-ee0ed2826dd9 req-3abf97b5-1ebb-419f-8aa1-82869349d31e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036361 Sep 28 15:45:06.392031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 120/245] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:45:06.492963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:06.501214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-da29803a-ce07-425b-913d-83d287e815db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.205493 Sep 28 15:45:06.501774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 126/246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:06 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:07.362259 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:07.363039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=6 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:07.367064 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:07.367747 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:07.374600 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:07.375068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:07.375485 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:07.376150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:07.376603 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:07.377004 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:07.512596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:07.520197 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-36283760-96d8-4c24-9f18-60b1764cf918 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.158831 Sep 28 15:45:07.520765 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 121/247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:07 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:07.520987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=6 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:07.525503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:07.526102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:07.532934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:07.533412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:07.533839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:07.534545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:07.534987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:07.535410 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:07.750623 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:07.758337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dbdf8d66-68bf-49f8-bb97-a4aa001815c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.238183 Sep 28 15:45:07.758950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 127/248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:07 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:08.543499 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:08.544952 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:08.551461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.551945 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.552379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.553094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.553546 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.553964 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.687761 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:08.697157 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e151452c-463e-4b14-9c4a-b83af7b813df tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.157398 Sep 28 15:45:08.697660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 122/249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:08 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:08.784434 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:08.785147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:08.794588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.795192 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.795691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.796457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.796975 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.797614 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.030250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:09.044341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d421eef0-d64d-4219-b577-98d1e1fe297b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1502 microversion: 2.1 time: 0.265138 Sep 28 15:45:09.046461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 128/250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:08 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1502 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:09.071348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e556229b-f241-413b-9a1d-536c5cdde6e8"}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:09.074319 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:09.081424 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.082219 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.082899 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.083820 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.084516 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.085378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.125548 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] HTTP exception thrown: Cannot 'attach_volume' instance 3cfd6533-e103-4f9d-905a-d839c4834f77 while it is in vm_state rescued Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Request method failure captured: Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: POST /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77/os-volume_attachments HTTP/1.1 Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 74 Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGt_2er79tVKTjBRL98AgLQ_NLvBE7zer4-8cNgwLpFCOZgaAF5fKYfvOXJAy-UYlFyUQWO-J5J291d2aXooMI-h8WPpmGYf2OrluKjAKOnvIj7hewQPtaL9EOgrGeWyogrmizVIEwdbDxX339uzpnhSAYrWbhy1Vt82fWp7H6Z54kw Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:45:09.127474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22d9fd2a9bec45938dd18540b1334a3b"}]}] Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: d8581d46699041d5a4dcb8a43034863e Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {"volumeAttachment": {"volumeId": "e556229b-f241-413b-9a1d-536c5cdde6e8"}} Sep 28 15:45:09.128920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: > Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Cannot 'attach_volume' instance 3cfd6533-e103-4f9d-905a-d839c4834f77 while it is in vm_state rescued Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'server_id': '3cfd6533-e103-4f9d-905a-d839c4834f77', 'body': {'volumeAttachment': {'volumeId': 'e556229b-f241-413b-9a1d-536c5cdde6e8'}}} Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3cfd6533-e103-4f9d-905a-d839c4834f77 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:45:09.129766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3cfd6533-e103-4f9d-905a-d839c4834f77 while it is in vm_state rescued Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:09.131205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:09.132435 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:45:09.132435 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:45:09.132435 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3cfd6533-e103-4f9d-905a-d839c4834f77 while it is in vm_state rescued Sep 28 15:45:09.132435 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.132435 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Returning 409 to user: Cannot 'attach_volume' instance 3cfd6533-e103-4f9d-905a-d839c4834f77 while it is in vm_state rescued {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:45:09.132435 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-150a4c1a-727f-4e89-8a9e-acd9f9e93879 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063648 Sep 28 15:45:09.133777 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 123/251] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 15:45:09 2022] POST /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 15:45:09.138690 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:09.139241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:09.145183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.145787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.146211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.146907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.147348 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.147758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.223773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0dcac4b2-9a3c-40db-9b22-63c1ac603d97 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77/action" status: 202 len: 0 microversion: 2.1 time: 0.088958 Sep 28 15:45:09.227572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 129/252] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:45:09 2022] POST /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:45:09.234290 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:09.235172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:09.241786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.242234 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.242732 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.243391 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.243858 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.244351 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.379522 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:09.387257 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-bc97a933-a8c1-4287-a287-b921f763e063 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.158162 Sep 28 15:45:09.387829 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 124/253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:09 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:09.721557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:09.722537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:09.730494 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.731100 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.731730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.732708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.733222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.733853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.863577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:09.871932 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ed50296e-8743-4e1b-982c-db95c50b37c7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.155538 Sep 28 15:45:09.872502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 130/254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:09 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:10.411863 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:10.412702 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:10.418660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:10.419143 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:10.419575 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:10.420255 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:10.420706 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:10.421126 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:10.559591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:10.568372 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c1e99de2-20e2-41c5-acdd-c549a1c60ba3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.160324 Sep 28 15:45:10.568954 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 125/255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:10 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:10.894540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:10.895202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:10.902234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:10.902749 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:10.903188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:10.903876 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:10.904325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:10.904738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:11.099182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:11.109415 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bba9b499-cfc6-4d70-ae41-e4671566e913 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.218895 Sep 28 15:45:11.110687 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 131/256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:10 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:11.591009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:11.591656 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:11.598100 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:11.598610 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:11.599034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:11.599716 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:11.600150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:11.600560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:11.618120 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:11.730954 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:11.738604 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1467fc95-e373-4d9e-8464-2b1582599362 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.151384 Sep 28 15:45:11.739160 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 126/257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:11 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:12.134729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:12.135336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:12.142662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:12.143084 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:12.143513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:12.144201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:12.144647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:12.145064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:12.358137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:12.365903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3f3e38a1-177b-4414-901c-aefa449abcea tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.235023 Sep 28 15:45:12.367477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 132/258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:12 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:12.763135 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:12.763727 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:12.769944 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:12.770439 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:12.770927 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:12.771679 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:12.772119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:12.772540 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:12.902722 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:12.910940 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1beca7d9-4550-4c07-a689-4af82887cc27 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.153443 Sep 28 15:45:12.911500 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 127/259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:12 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:13.392802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:13.393406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:13.400060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:13.400620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:13.401048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:13.401728 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:13.402168 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:13.402608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:13.533823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:13.542049 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ef15e4c2-0b68-4186-8778-1493cb90196a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.153547 Sep 28 15:45:13.542646 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 133/260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:13 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:13.934852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:13.935475 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:13.942596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:13.943076 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:13.943504 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:13.944189 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:13.944629 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:13.945047 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:14.076320 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:14.083838 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-123b51cd-2f01-48ba-b7e5-f7b2345ee5a4 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.153312 Sep 28 15:45:14.084425 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 128/261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:13 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:14.564525 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:14.565130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:14.571526 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:14.571997 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:14.572422 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:14.573105 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:14.573551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:14.573968 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:14.708182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:14.710566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:14.718322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3d341263-0b37-41ae-8060-a5f5cbd2551b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.157713 Sep 28 15:45:14.718930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 134/262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:14 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:15.106985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:15.107606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:15.113733 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:15.114217 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:15.114756 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:15.115448 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:15.115898 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:15.116320 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:15.249077 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:15.256773 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e20c19ac-b43b-453f-ab69-266dc7cb2584 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.153746 Sep 28 15:45:15.257336 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 129/263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:15 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:15.741582 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:15.742191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:15.749955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:15.750462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:15.750895 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:15.751615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:15.752060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:15.752478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:15.881048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:15.890069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-86c7e076-7605-4908-8342-8e4937887e21 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.152834 Sep 28 15:45:15.890819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 135/264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:15 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:16.280978 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:16.281579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:16.288363 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.288880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.289305 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.289983 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.290437 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.290871 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.423783 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:16.431491 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6eae94cf-44ba-41a0-8ca8-111d04acd190 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.154986 Sep 28 15:45:16.432168 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 130/265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:16 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:16.914171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:16.914820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:16.922162 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.922686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.923117 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.923818 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.924268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.924687 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:17.066381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:17.074018 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-344b32a6-3881-4804-af82-28624e8bb805 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.164688 Sep 28 15:45:17.074616 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 136/266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:16 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:17.456130 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:17.456853 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:17.463331 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:17.463805 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:17.464226 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:17.464903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:17.465341 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:17.465750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:17.613533 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:17.621398 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-60717793-bfd7-4690-8f59-427019059cee tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.169953 Sep 28 15:45:17.621971 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 131/267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:17 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:18.096393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:18.097100 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:18.103559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:18.104034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:18.104464 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:18.105146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:18.105599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:18.106016 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:18.374247 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:18.382133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1f4b672e-722f-4bd0-8fe8-adb76641760e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.289575 Sep 28 15:45:18.382732 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 137/268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:18 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:18.645411 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:18.645947 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:18.651937 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:18.652416 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:18.652876 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:18.653556 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:18.654009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:18.654444 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:18.788164 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:18.796635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a0b6aa20-5fb2-4ae4-be7f-510f1d95f4d2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.155209 Sep 28 15:45:18.797209 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 132/269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:18 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:19.408213 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:19.408742 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:19.415201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:19.415673 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:19.416096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:19.416764 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:19.417202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:19.417608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:19.549850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:19.557917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1b55842a-c970-4c90-819d-3a8292dfc668 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.154015 Sep 28 15:45:19.558497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 138/270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:19 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:19.819905 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:19.820518 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:19.827998 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:19.828484 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:19.829392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:19.830161 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:19.830645 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:19.831069 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:19.870302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-3c909372-a0aa-4c1a-ad43-6a199b159f01 req-58196538-3bb6-4de0-bf40-330462c4ba20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fa7624-3d5a-4557-a626-2b59a4473ba1", "name": "network-vif-plugged", "status": "completed", "tag": "a98ebd64-b1d9-409e-bb19-39c43a8d9562"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:19.889123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3c909372-a0aa-4c1a-ad43-6a199b159f01 req-58196538-3bb6-4de0-bf40-330462c4ba20 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:19.889854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3c909372-a0aa-4c1a-ad43-6a199b159f01 req-58196538-3bb6-4de0-bf40-330462c4ba20 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:19.890507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3c909372-a0aa-4c1a-ad43-6a199b159f01 req-58196538-3bb6-4de0-bf40-330462c4ba20 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:19.904167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-3c909372-a0aa-4c1a-ad43-6a199b159f01 req-58196538-3bb6-4de0-bf40-330462c4ba20 service nova] Creating event network-vif-plugged:a98ebd64-b1d9-409e-bb19-39c43a8d9562 for instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 on hv-cinder-85931 Sep 28 15:45:19.909477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-3c909372-a0aa-4c1a-ad43-6a199b159f01 req-58196538-3bb6-4de0-bf40-330462c4ba20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042745 Sep 28 15:45:19.910450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 139/271] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:19.976618 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:19.985612 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5c2af474-05e7-49b9-8bb7-80ad995296c5 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1510 microversion: 2.1 time: 0.169587 Sep 28 15:45:19.986172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 133/272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:19 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:20.582296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:20.583024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:20.591316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:20.592406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:20.593773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:20.593773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:20.594155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:20.594531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:20.732443 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:20.741119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b579bd5b-0e68-4ce7-8396-803c62a10bd2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.163486 Sep 28 15:45:20.741706 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 140/273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:20 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:21.008787 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:21.009497 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:21.016155 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.016740 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.017175 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.018052 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.018542 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.018968 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.151888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:21.160275 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-733a28ef-a135-4542-9679-9226042bf99e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1516 microversion: 2.1 time: 0.155249 Sep 28 15:45:21.160880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 134/274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:21 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:21.764303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:21.764912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:21.771444 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.771927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.772363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.773162 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.773605 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.774576 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.913068 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:21.921659 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bb39661a-4f35-4c4e-8c1d-33b1316f06ac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.161650 Sep 28 15:45:21.922345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 141/275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:21 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:22.944817 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:22.945496 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:22.951689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:22.952174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:22.952598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:22.953290 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:22.953738 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:22.954157 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:23.089500 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:23.097280 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4b0c7899-a137-4bfe-ae26-536376beb865 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1314 microversion: 2.1 time: 0.156471 Sep 28 15:45:23.097854 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 135/276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:22 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:23.666979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0ff11a1f-0ee3-4ac6-b614-f3a34719dd4c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'create', calling method: .version_select at 0x7f8fcff9f550>, body: {"keypair": {"name": "tempest-keypair-1583358113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFD+xPimzdhOY4YSIAHg4nqdSkNSIDfPvgMtlm/bwOoOJpyd/rN5teQKOy+MyFEVMdil9e0aAOzKwg8SLqqrdFYVa5jUnwVLL6vTYhPgTnnblr4X6my9fl1oEjXRUUcxQ=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:23.686156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-0ff11a1f-0ee3-4ac6-b614-f3a34719dd4c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Getting quotas for project 22d9fd2a9bec45938dd18540b1334a3b. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:45:23.690558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-0ff11a1f-0ee3-4ac6-b614-f3a34719dd4c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Getting quotas for user d8581d46699041d5a4dcb8a43034863e and project 22d9fd2a9bec45938dd18540b1334a3b. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:45:23.714119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0ff11a1f-0ee3-4ac6-b614-f3a34719dd4c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051583 Sep 28 15:45:23.715056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 142/277] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 15:45:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:24.120483 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:24.121092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:24.131318 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:24.131729 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:24.132212 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:24.133125 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:24.133577 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:24.134083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:24.272488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:24.280123 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6e28525f-a910-4084-9173-45a924cf994b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1497 microversion: 2.1 time: 0.163437 Sep 28 15:45:24.280690 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 136/278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:24 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:24.835670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:24.837609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:24.858843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:24.859831 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:24.860429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:24.861333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:24.861841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:24.862319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:24.890645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:45:24.985511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1976387459", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdd92b40-f166-4b7e-8e83-24dc81134fe4"}], "security_groups": [{"name": "tempest-securitygroup--1687617498"}], "key_name": "tempest-keypair-1583358113", "user_data": "}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:24.998159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d01e3ca2-797f-4c36-8a13-8f6d0fe6a150 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "DELETE /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 204 len: 0 microversion: 2.1 time: 0.166457 Sep 28 15:45:25.003039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 143/279] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:45:24 2022] DELETE /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:45:25.005493 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:25.012367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:25.013522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:25.021146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:25.021633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:25.022064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:25.022793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:25.023241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:25.023863 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:25.173911 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] validate_networks() for [('cdd92b40-f166-4b7e-8e83-24dc81134fe4', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:45:25.323123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:25.331621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-98deca41-5dc9-4e4d-91c7-ebbdda6b53a2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1503 microversion: 2.1 time: 0.327060 Sep 28 15:45:25.332202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 144/280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:25 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:25.691359 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:45:25.692122 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:45:25.692591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:45:25.693157 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:45:25.693567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:45:25.703735 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:25.704434 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:25.704802 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:25.705687 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:25.706217 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:25.706741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:25.724647 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Getting quotas for project 22d9fd2a9bec45938dd18540b1334a3b. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:45:25.728485 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Getting quotas for user d8581d46699041d5a4dcb8a43034863e and project 22d9fd2a9bec45938dd18540b1334a3b. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:45:25.739608 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:45:25.741906 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:45:25.790075 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-477b1c95-e537-4486-bd47-5d14f2a1c8e6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.812607 Sep 28 15:45:25.790827 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 137/281] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:45:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:45:25.802105 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dbb7bec7-e2ab-45ca-a959-619099f79f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:25.802832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dbb7bec7-e2ab-45ca-a959-619099f79f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:25.864375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dbb7bec7-e2ab-45ca-a959-619099f79f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:25.872124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dbb7bec7-e2ab-45ca-a959-619099f79f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1246 microversion: 2.1 time: 0.073912 Sep 28 15:45:25.873528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 145/282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:25 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:26.354769 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:26.355564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:26.368844 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:26.369392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:26.369878 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:26.370679 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:26.371173 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:26.371601 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:26.538855 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:26.548891 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e1c4e1a2-55f6-4b78-a9b1-82710ca8f1ae tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1503 microversion: 2.1 time: 0.197988 Sep 28 15:45:26.549541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 138/283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:26 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:26.895796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:26.896390 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:26.898837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:26.906981 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:26.907797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:26.907920 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:26.908972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:26.908972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:26.909409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:26.991472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:27.003739 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cedf5a7b-cf68-4695-9a11-a7d4bfb37d5d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1242 microversion: 2.1 time: 0.110861 Sep 28 15:45:27.004860 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 146/284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:26 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:27.571709 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:27.573490 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:27.582380 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:27.586456 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:27.586959 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:27.587750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:27.588290 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:27.588774 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:27.764965 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:27.774805 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-47ab23b4-aaf6-420d-87cf-346c9a82920b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1461 microversion: 2.1 time: 0.206805 Sep 28 15:45:27.795098 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 139/285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:27 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1461 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:27.828433 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-dd2b077d-baf2-4f73-950d-6fdec9712761 req-bcac7e89-c569-4086-8660-43f600ad42bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fa7624-3d5a-4557-a626-2b59a4473ba1", "name": "network-vif-deleted", "tag": "a98ebd64-b1d9-409e-bb19-39c43a8d9562"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:27.842930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-dd2b077d-baf2-4f73-950d-6fdec9712761 req-bcac7e89-c569-4086-8660-43f600ad42bc service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:27.843649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-dd2b077d-baf2-4f73-950d-6fdec9712761 req-bcac7e89-c569-4086-8660-43f600ad42bc service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:27.844230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-dd2b077d-baf2-4f73-950d-6fdec9712761 req-bcac7e89-c569-4086-8660-43f600ad42bc service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:27.858179 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-dd2b077d-baf2-4f73-950d-6fdec9712761 req-bcac7e89-c569-4086-8660-43f600ad42bc service nova] Creating event network-vif-deleted:a98ebd64-b1d9-409e-bb19-39c43a8d9562 for instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 on hv-cinder-85931 Sep 28 15:45:27.862923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-dd2b077d-baf2-4f73-950d-6fdec9712761 req-bcac7e89-c569-4086-8660-43f600ad42bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038141 Sep 28 15:45:27.864690 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 147/286] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:28.028289 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:28.029436 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:28.036474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.037023 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.037554 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.039053 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.039694 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.040277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.133240 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:28.141792 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-abcd9f8b-ad4d-4c58-8fb3-7b16c9f4a174 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1304 microversion: 2.1 time: 0.118121 Sep 28 15:45:28.142830 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 140/287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:28 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:28.803961 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:28.804828 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:28.812119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.812596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.813020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.813703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.814139 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.814612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.846387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.846928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.847407 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.847845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lazy-loading 'fault' on Instance uuid 88fa7624-3d5a-4557-a626-2b59a4473ba1 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:28.888964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:28.896783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ef4bfbe2-4bc9-455c-85f5-ba87cabb41c4 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1304 microversion: 2.1 time: 0.097516 Sep 28 15:45:28.897352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 148/288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:28 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:29.166641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:29.167249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:29.173832 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:29.174304 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:29.174835 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:29.175511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:29.175963 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:29.176381 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:29.305237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:29.313096 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-66e51a58-fa99-4719-ba56-c5ddaf8bf148 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.150349 Sep 28 15:45:29.313658 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 141/289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:29 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:29.919609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:29.920210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:29.926629 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:29.927098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:29.927515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:29.928183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:29.928618 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:29.929027 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:29.960791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:29.961170 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:29.961590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:29.962019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lazy-loading 'fault' on Instance uuid 88fa7624-3d5a-4557-a626-2b59a4473ba1 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:30.002664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:30.010246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8bce6a82-9278-49a1-99ac-60173f4ea2f9 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1304 microversion: 2.1 time: 0.094617 Sep 28 15:45:30.010846 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 149/290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:29 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:30.336079 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:30.336713 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:30.342830 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:30.343306 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:30.343737 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:30.344420 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:30.344866 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:30.345289 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:30.474619 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:30.483322 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-97113bf8-b6cd-4e18-913e-5657015433ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.151123 Sep 28 15:45:30.483906 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 142/291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:30 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:31.033338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:31.033948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:31.040353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.040825 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.041249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.041920 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.042360 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.042795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.073700 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.074287 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.074623 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.075058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lazy-loading 'fault' on Instance uuid 88fa7624-3d5a-4557-a626-2b59a4473ba1 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:31.118046 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:31.125839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cb19a31e-122f-44f0-8031-57bc2c3c191e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1304 microversion: 2.1 time: 0.096872 Sep 28 15:45:31.126400 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 150/292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:31 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:31.506560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:31.507202 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:31.513917 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.514392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.514852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.515543 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.515978 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.516398 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.646814 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:31.650137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:31.655228 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b9ab859d-b313-4fbf-8e61-7bc5b72422d7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.152526 Sep 28 15:45:31.655791 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 143/293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:31 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:32.149322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:32.150269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:32.158406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.159016 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.159559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.160539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.161084 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.161625 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.196657 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.197298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.197814 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.198369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lazy-loading 'fault' on Instance uuid 88fa7624-3d5a-4557-a626-2b59a4473ba1 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:32.247921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:32.250620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:32.258234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d1357e1f-cc34-4a88-a95f-625b07840312 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 200 len: 1304 microversion: 2.1 time: 0.112800 Sep 28 15:45:32.268363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 151/294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:32 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:32.680299 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:32.681819 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:32.692878 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.693364 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.693788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.694512 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.694956 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.695370 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.834031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:32.845727 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8ec9a5e0-9d60-4bde-9492-08edf7b5b892 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.171626 Sep 28 15:45:32.846702 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 144/295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:32 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:32.921842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-c9599015-535d-4c37-8224-6808ca911c27 req-d2f0ec79-2454-4476-af8d-7e04d8327aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bcecf7-6cc5-461e-a267-0c215dacf388", "tag": "649b2c71-9e63-43df-99c9-186b4043bdb6"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:32.938519 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-c9599015-535d-4c37-8224-6808ca911c27 req-d2f0ec79-2454-4476-af8d-7e04d8327aab service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.939182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-c9599015-535d-4c37-8224-6808ca911c27 req-d2f0ec79-2454-4476-af8d-7e04d8327aab service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.939763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-c9599015-535d-4c37-8224-6808ca911c27 req-d2f0ec79-2454-4476-af8d-7e04d8327aab service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.941742 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-900049100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1124873369", "security_groups": [{"name": "tempest-secgroup-smoke-1484844865"}], "networks": [{"uuid": "c2599e1c-f71e-4ef4-9f35-d0fa30f51dee"}], "block_device_mapping_v2": [{"uuid": "8ac131b6-bdcc-4783-8628-2172be12c633", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:32.953208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-c9599015-535d-4c37-8224-6808ca911c27 req-d2f0ec79-2454-4476-af8d-7e04d8327aab service nova] Creating event network-changed:649b2c71-9e63-43df-99c9-186b4043bdb6 for instance 13bcecf7-6cc5-461e-a267-0c215dacf388 on hv-cinder-85931 Sep 28 15:45:32.958773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-c9599015-535d-4c37-8224-6808ca911c27 req-d2f0ec79-2454-4476-af8d-7e04d8327aab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044059 Sep 28 15:45:32.959369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 152/296] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:33.063334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] validate_networks() for [('c2599e1c-f71e-4ef4-9f35-d0fa30f51dee', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:45:33.281875 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:33.282795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: 88fa7624-3d5a-4557-a626-2b59a4473ba1] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:33.288953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.289446 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.289874 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.290592 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.291043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.291463 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.314490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] HTTP exception thrown: Instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 could not be found. Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Request method failure captured: Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 HTTP/1.1 Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGv0LXpGL-NQ0YuWd02c-AknluWIrWwBZKMuIEYSXP6tmrIX_kDKQ8dTOCppjModoIyOiK4xm2j-05arNJdPSrmdmcKXsR8AJo1dW-mNo6NJ-ARO67G9-hRKBtmBX4CemyN3z6I0nhnvD04SusOHFVnmsJS0NyuH6FwrPsK4CasgcE0 Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: ff0f334384454c7daba615e52ce21cd1 Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesActionsTest-1174248459 Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:45:33.316214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ff0f334384454c7daba615e52ce21cd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ff0f334384454c7daba615e52ce21cd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ff0f334384454c7daba615e52ce21cd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ff0f334384454c7daba615e52ce21cd1"}]}] Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesActionsTest-1174248459 Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: ff0f334384454c7daba615e52ce21cd1 Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesActionsTest-1174248459 Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesActionsTest-1174248459-project Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: b0da6e03372642b8b2ee06780cd03714 Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesActionsTest-1174248459-project Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 could not be found. Sep 28 15:45:33.317979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '88fa7624-3d5a-4557-a626-2b59a4473ba1'} Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 could not be found. Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:45:33.319020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 could not be found. Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 could not be found. Sep 28 15:45:33.320552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:45:33.325171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Returning 404 to user: Instance 88fa7624-3d5a-4557-a626-2b59a4473ba1 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:45:33.325171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b9efbd3e-2f05-4f92-877a-1746085abc51 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1" status: 404 len: 111 microversion: 2.1 time: 0.040548 Sep 28 15:45:33.325171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 153/297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:33 2022] GET /compute/v2.1/servers/88fa7624-3d5a-4557-a626-2b59a4473ba1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:45:33.429503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1085690788", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "networks": [{"uuid": "cb563d42-0f77-4789-bc2c-f006c85db118"}]}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:33.468778 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:45:33.469198 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:45:33.469663 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:45:33.470062 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:45:33.470629 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:45:33.480684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.481456 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.482146 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.483122 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.483596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.485034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.487655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] validate_networks() for [('cb563d42-0f77-4789-bc2c-f006c85db118', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:45:33.504864 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Getting quotas for project b62283fd6a124de0a32ad8f586cf997e. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:45:33.508838 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Getting quotas for user 0ca903cc98a24621b7c3be488e3e7c5e and project b62283fd6a124de0a32ad8f586cf997e. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:45:33.568741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:45:33.570816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ac131b6-bdcc-4783-8628-2172be12c633',volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:45:33.727670 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-87737f0c-a692-495e-9bdd-65fcea05d609 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791372 Sep 28 15:45:33.729323 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 145/298] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:45:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:45:33.742486 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-57b29694-bb14-43ff-910a-36016fbe2a03 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:33.743317 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-57b29694-bb14-43ff-910a-36016fbe2a03 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:33.819029 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-57b29694-bb14-43ff-910a-36016fbe2a03 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:33.828083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-57b29694-bb14-43ff-910a-36016fbe2a03 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1088 microversion: 2.1 time: 0.088673 Sep 28 15:45:33.828246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 146/299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:33 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:33.873909 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:33.874733 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:33.881589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.882069 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.882721 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.883578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.884024 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.884514 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.966379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:45:33.967917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:45:33.969602 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:45:33.970915 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:45:33.971354 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:45:33.990640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.991566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.991946 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.992825 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.993535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.994024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:34.015662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Getting quotas for project ff0f334384454c7daba615e52ce21cd1. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:45:34.020623 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Getting quotas for user b0da6e03372642b8b2ee06780cd03714 and project ff0f334384454c7daba615e52ce21cd1. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:45:34.037156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:45:34.041026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:45:34.054851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:34.064409 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8dc816c4-2775-4f17-982d-82a0c3c75524 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.196872 Sep 28 15:45:34.079023 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 147/300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:33 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:34.100313 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2f7a40fc-4c1a-4f24-bda5-c352b7e1b521 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674557 Sep 28 15:45:34.101313 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 154/301] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:45:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 15:45:34.113153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b75df25a-fc43-4bba-a92c-6adbed4f5262 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:34.113755 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b75df25a-fc43-4bba-a92c-6adbed4f5262 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:34.209100 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b75df25a-fc43-4bba-a92c-6adbed4f5262 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:34.217632 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b75df25a-fc43-4bba-a92c-6adbed4f5262 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1214 microversion: 2.1 time: 0.107731 Sep 28 15:45:34.218285 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 148/302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:34 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:34.849588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:34.850194 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:34.856960 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:34.857451 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:34.857876 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:34.858587 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:34.859038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:34.859448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:34.920007 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:34.928217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e28f9aaa-95ff-49d0-8caf-7fc6257364dd tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1138 microversion: 2.1 time: 0.082879 Sep 28 15:45:34.928876 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 155/303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:34 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:35.088563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:35.089290 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:35.096148 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.096710 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.097224 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.097980 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.098704 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.099038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.233702 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:35.240898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:35.241652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:35.241773 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d3ac4eaa-68a3-4c4a-9ecc-2f0903b31f33 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.157194 Sep 28 15:45:35.250802 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 149/304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:35 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:35.256074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.256641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.257250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.257871 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.258329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.258795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.323280 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:35.331563 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-17f0a662-5b72-45d8-8b13-68c462f5f30b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1218 microversion: 2.1 time: 0.095381 Sep 28 15:45:35.332128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 156/305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:35 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:35.951553 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:35.952163 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:35.958209 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.958718 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.959144 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.959832 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.960277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.960694 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.022936 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:36.031256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-01d445e1-1f0e-4eee-891f-f5a1700b5d6f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1138 microversion: 2.1 time: 0.083786 Sep 28 15:45:36.031843 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 150/306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:35 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:36.264899 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:36.266025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:36.271974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.272454 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.272895 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.273579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.274024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.274462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.353197 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:36.353957 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:36.359916 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.360393 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.360823 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.361508 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.361957 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.362378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.413780 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:36.421533 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b36d1fff-4817-4293-b220-0d2acffe2324 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.160423 Sep 28 15:45:36.422095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 157/307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:36 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:36.429244 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:36.437073 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ab3ae6dd-52e1-462b-847d-d513627e21ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1218 microversion: 2.1 time: 0.087693 Sep 28 15:45:36.437624 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 151/308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:36 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:37.054641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:37.055243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:37.061912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:37.062392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:37.062839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:37.063514 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:37.063954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:37.064367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:37.127097 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:37.135012 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3a0f9287-1098-499f-a67c-e2ccdbe96192 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1138 microversion: 2.1 time: 0.084364 Sep 28 15:45:37.135567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 158/309] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:37 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:37.444957 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:37.445563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:37.451533 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:37.452035 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:37.452563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:37.453137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:37.453582 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:37.454000 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:37.460030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:37.460639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:37.467690 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:37.468178 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:37.468607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:37.469304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:37.469759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:37.470171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:37.551169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:37.559176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bd8546cf-bf6d-4c6a-8f30-e0dcab3a0c0f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1218 microversion: 2.1 time: 0.103065 Sep 28 15:45:37.559750 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 159/310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:37 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:37.605444 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:37.613690 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8b5a7760-992c-4d79-bf55-520e6fc93955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.172563 Sep 28 15:45:37.614254 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 152/311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:37 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:38.157892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:38.158550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:38.164595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:38.165066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:38.165493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:38.166169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:38.166670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:38.167090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:38.227548 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:38.235091 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-040bdc77-afc9-43d6-a48e-c80f76c8e382 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1138 microversion: 2.1 time: 0.081696 Sep 28 15:45:38.235657 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 160/312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:38 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:38.581875 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:38.582498 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:38.588391 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:38.588861 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:38.589283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:38.589955 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:38.590396 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:38.590836 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:38.636044 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:38.636872 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:38.644665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:38.645245 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:38.645788 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:38.646602 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:38.647126 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:38.647633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:38.656880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:38.668599 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b56872a4-e415-4ef7-963e-02b6b4758dec tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1218 microversion: 2.1 time: 0.090515 Sep 28 15:45:38.669709 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 153/313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:38 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:38.782010 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:38.790036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-86f09474-ca14-4a41-a45e-e855f21642db tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.157970 Sep 28 15:45:38.790636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 161/314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:38 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:39.258830 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:39.259447 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:39.265459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:39.266303 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:39.266402 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:39.267052 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:39.267494 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:39.267908 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:39.327392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:39.334871 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1746ef97-91cf-4e82-8b29-b98cfbbb6068 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1138 microversion: 2.1 time: 0.080039 Sep 28 15:45:39.335439 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 154/315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:39 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:39.691896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:39.693260 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:39.704710 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:39.706277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:39.707176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:39.707930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:39.708417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:39.708940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:39.792795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:39.803125 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f515dbfc-0149-4b76-abcf-d944f28590ce tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1218 microversion: 2.1 time: 0.115130 Sep 28 15:45:39.811015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 162/316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:39 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:39.815635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:39.816507 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:39.822774 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:39.823354 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:39.823849 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:39.824607 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:39.825663 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:39.826234 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:39.958428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:39.966934 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4fd5987f-f17b-4139-89f8-e7174dec32be tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.155465 Sep 28 15:45:39.967640 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 155/317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:39 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:40.358720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:40.359320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:40.365397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:40.365916 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:40.366313 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:40.367069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:40.367520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:40.367944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:40.428334 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:40.436842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e4f62dfd-0fcc-48a7-959e-5f57b4084dc4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1186 microversion: 2.1 time: 0.082515 Sep 28 15:45:40.437415 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 163/318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:40 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:40.829315 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:40.829832 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:40.836060 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:40.836546 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:40.836965 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:40.837651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:40.838092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:40.838545 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:40.898518 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:40.906804 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-eff15942-b00d-4d7a-a9d7-27b44d4a61a7 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1210 microversion: 2.1 time: 0.083775 Sep 28 15:45:40.907368 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 156/319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:40 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:40.989092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:40.989723 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:40.996220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:40.996702 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:40.997135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:40.997822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:40.998269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:40.998731 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:41.127126 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:41.134801 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fc28fba2-4d6e-490b-bf91-279c83d679ab tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.149547 Sep 28 15:45:41.135373 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 164/320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:40 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:41.459552 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:41.460151 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:41.466040 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:41.466546 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:41.466967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:41.467631 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:41.468064 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:41.468467 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:41.529968 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:41.537719 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5ba7abfe-5ab3-4036-9af3-a409274981ec tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1186 microversion: 2.1 time: 0.081969 Sep 28 15:45:41.538277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 157/321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:41 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:41.932267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:41.933122 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:41.939684 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:41.940161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:41.940593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:41.941359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:41.941831 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:41.942258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:42.001885 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:42.009484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f51aece2-7901-4225-be19-db7d66e96f3f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1210 microversion: 2.1 time: 0.081669 Sep 28 15:45:42.010050 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 165/322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:41 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:42.158690 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:42.159424 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:42.166696 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:42.167342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:42.167873 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:42.169371 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:42.170066 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:42.170639 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:42.325533 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:42.333092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-22b4b53c-bf6d-449f-9a2e-fd7906b9dc73 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.178766 Sep 28 15:45:42.333651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 158/323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:42 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:42.564077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:42.565124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:42.572012 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:42.572480 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:42.572905 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:42.573581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:42.574023 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:42.574455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:42.634825 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:42.643381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-48093ca6-cb08-42d5-89b6-15600c05adee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1186 microversion: 2.1 time: 0.086423 Sep 28 15:45:42.643944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 166/324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:42 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:43.032173 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:43.032778 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:43.039000 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:43.039480 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:43.039913 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:43.040596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:43.041036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:43.041453 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:43.101256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:43.109250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f193d00f-712d-4591-83b3-35a911184d26 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1210 microversion: 2.1 time: 0.080943 Sep 28 15:45:43.109809 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 159/325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:43 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:43.356638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:43.357237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:43.363881 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:43.364358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:43.364782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:43.365465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:43.365944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:43.366356 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:43.511442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:43.519797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7ab369de-e617-4e5c-9c42-d3465eb3e50d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.167070 Sep 28 15:45:43.526456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 167/326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:43 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:43.667158 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:43.667761 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:43.670233 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=4 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:43.675252 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:43.675737 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:43.676172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:43.676989 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:43.677589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:43.678017 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:43.738642 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:43.746155 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-df95a1f7-420a-4c2f-8b9e-b862f0462b55 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1186 microversion: 2.1 time: 0.082751 Sep 28 15:45:43.746780 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 160/327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:43 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:44.133670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:44.134276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:44.136276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:44.136990 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=12 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:44.143677 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:44.144156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:44.144590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:44.145274 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:44.145722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:44.146142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:44.209393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:44.217310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3b1f0b61-d3d4-471f-9722-bdf3b539ff2e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1210 microversion: 2.1 time: 0.087476 Sep 28 15:45:44.217880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 168/328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:44 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:44.550230 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:44.552867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:44.561392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=16 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:44.579230 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:44.582139 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:44.583047 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:44.584291 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:44.584856 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:44.586385 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:44.768873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:44.769887 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:44.780797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:44.784914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:44.785399 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:44.787151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:44.787621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:44.789383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:44.817643 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:44.827731 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-41888cd9-31f5-4243-b1f0-e1648c60fd61 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.288627 Sep 28 15:45:44.831683 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 161/329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:44 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:44.868026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:44.879535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-47d7e920-0142-4b34-a5db-940657967548 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1204 microversion: 2.1 time: 0.114379 Sep 28 15:45:44.894518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 169/330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:44 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1204 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:45.241146 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:45.242820 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:45.251866 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:45.252811 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:45.253824 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:45.254759 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:45.255406 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:45.256016 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:45.346299 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:45.355411 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-60ab4103-37c8-4706-a80e-54f67f510450 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1266 microversion: 2.1 time: 0.118855 Sep 28 15:45:45.360957 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 162/331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:45 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:45.854089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:45.855562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:45.862692 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:45.863613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:45.864070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:45.864780 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:45.865230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:45.865649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:45.882347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=100 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:45.904717 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:45.905321 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:45.911716 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:45.912488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:45.913043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:45.913927 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:45.914373 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:45.914971 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:45.922285 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:46.139668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:46.148482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fc4ce224-453d-45a2-99a7-8d51d6e2c75f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.298479 Sep 28 15:45:46.149315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 170/332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:45 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:46.164782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:46.172475 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-94efe9da-ca40-41f4-99c8-7507ef1fe1d3 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1272 microversion: 2.1 time: 0.271939 Sep 28 15:45:46.172955 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 163/333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:45 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:46.295324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-6321d6be-9568-4236-b7f0-c61159d37f90 req-4ebc8ad2-51a5-4ede-85e2-7a4864375196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc8195d-c5bd-4e78-9001-13215dfedb9c", "tag": "6fe3578e-1526-411a-a9b7-3e91f28a36fb"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:46.308501 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6321d6be-9568-4236-b7f0-c61159d37f90 req-4ebc8ad2-51a5-4ede-85e2-7a4864375196 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:46.309335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6321d6be-9568-4236-b7f0-c61159d37f90 req-4ebc8ad2-51a5-4ede-85e2-7a4864375196 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:46.310046 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6321d6be-9568-4236-b7f0-c61159d37f90 req-4ebc8ad2-51a5-4ede-85e2-7a4864375196 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:46.322518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-6321d6be-9568-4236-b7f0-c61159d37f90 req-4ebc8ad2-51a5-4ede-85e2-7a4864375196 service nova] Creating event network-changed:6fe3578e-1526-411a-a9b7-3e91f28a36fb for instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c on hv-cinder-85931 Sep 28 15:45:46.328547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-6321d6be-9568-4236-b7f0-c61159d37f90 req-4ebc8ad2-51a5-4ede-85e2-7a4864375196 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037198 Sep 28 15:45:46.329187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 171/334] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:45:46.380133 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:46.380731 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:46.386696 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:46.387669 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:46.388323 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:46.389009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:46.389443 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:46.389861 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:46.461184 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:46.469145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-85281854-9c7f-4d15-83c1-c10a0d442d1a tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1272 microversion: 2.1 time: 0.092801 Sep 28 15:45:46.469738 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 164/335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:46 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:47.173995 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:47.174511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:47.180490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:47.181032 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:47.181388 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:47.182077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:47.182806 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:47.183226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:47.195480 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:47.196314 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:47.202666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:47.203554 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:47.204058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:47.204758 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:47.205207 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:47.205648 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:47.400698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:47.410514 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-34e9d933-db41-4d4a-874a-8f790dd176ed tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.241972 Sep 28 15:45:47.411241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 172/336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:47 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:47.430826 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:47.439071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d7ce51ce-95a5-4fcf-9110-dedd04597031 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1272 microversion: 2.1 time: 0.247525 Sep 28 15:45:47.439647 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 165/337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:47 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:47.492423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:47.493305 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:47.499482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:47.499970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:47.500401 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:47.501190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:47.501718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:47.502346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:47.569794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:47.578234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5356f8b6-ebdc-4c39-b8a2-c68a24d45c5e tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1272 microversion: 2.1 time: 0.090639 Sep 28 15:45:47.579155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 173/338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:47 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:48.433546 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:48.434804 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:48.440717 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:48.441201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:48.441630 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:48.442373 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:48.442848 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:48.443270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:48.462384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:48.462994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:48.470913 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:48.473058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:48.475453 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:48.477063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:48.477905 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:48.479301 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:48.642536 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:48.652388 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c18a309f-850a-4052-a7e6-5ef9e658fe6f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.223040 Sep 28 15:45:48.653541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 166/339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:48 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:48.658295 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:48.658931 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:48.664678 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:48.665155 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:48.665577 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:48.666253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:48.666911 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:48.667260 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:48.680705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:48.690057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-756486ff-1adf-4382-be79-ebf3e76f4146 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1272 microversion: 2.1 time: 0.231387 Sep 28 15:45:48.690678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 174/340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:48 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:48.748717 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:48.757525 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-2854b266-6499-4a4a-9966-cfe0fea5e48b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1272 microversion: 2.1 time: 0.102818 Sep 28 15:45:48.758328 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 167/341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:48 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:49.120175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-5c2fd15f-a24d-4dc8-b807-acbe98afd9b9 req-c20948fb-1ebb-45d8-9a78-badd0e9ce2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bcecf7-6cc5-461e-a267-0c215dacf388", "name": "network-vif-plugged", "status": "completed", "tag": "649b2c71-9e63-43df-99c9-186b4043bdb6"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:49.133720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-5c2fd15f-a24d-4dc8-b807-acbe98afd9b9 req-c20948fb-1ebb-45d8-9a78-badd0e9ce2e2 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:49.134481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-5c2fd15f-a24d-4dc8-b807-acbe98afd9b9 req-c20948fb-1ebb-45d8-9a78-badd0e9ce2e2 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:49.135310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-5c2fd15f-a24d-4dc8-b807-acbe98afd9b9 req-c20948fb-1ebb-45d8-9a78-badd0e9ce2e2 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:49.148796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-5c2fd15f-a24d-4dc8-b807-acbe98afd9b9 req-c20948fb-1ebb-45d8-9a78-badd0e9ce2e2 service nova] Creating event network-vif-plugged:649b2c71-9e63-43df-99c9-186b4043bdb6 for instance 13bcecf7-6cc5-461e-a267-0c215dacf388 on hv-cinder-85931 Sep 28 15:45:49.153773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-5c2fd15f-a24d-4dc8-b807-acbe98afd9b9 req-c20948fb-1ebb-45d8-9a78-badd0e9ce2e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038401 Sep 28 15:45:49.154683 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 175/342] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:49.682650 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:49.683918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:49.690405 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:49.691607 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:49.692405 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:49.693445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:49.694333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:49.694960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:49.716950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:49.718454 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:49.727414 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:49.732911 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:49.733359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:49.734090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:49.734588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:49.735001 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:50.080494 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:50.089335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-72649698-3e90-44f3-8640-940dcf697f9a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.415754 Sep 28 15:45:50.090242 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 168/343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:49 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:50.102346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:50.107126 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:50.108488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:50.110707 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:50.116550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ccfa0cda-8450-4af1-b90f-bf52d5b9e59c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1272 microversion: 2.1 time: 0.405643 Sep 28 15:45:50.117103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 176/344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:49 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1272 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:50.118754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:50.119541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:50.120266 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:50.121271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:50.121967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:50.122642 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:50.324435 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:50.333009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dc496097-6d74-427b-a77a-b30d8693e0da tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.240972 Sep 28 15:45:50.333707 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 169/345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:50 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:50.690189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-9124c2b9-6502-45da-9f73-443bbcab3648 req-dfd48f8b-1507-4955-b69b-839affa1bdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b079b76c-a25b-4945-9ea6-b614c2b5aae7", "tag": "d48f3e4b-81db-4f87-98e2-6c1a0a761628"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:50.701335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9124c2b9-6502-45da-9f73-443bbcab3648 req-dfd48f8b-1507-4955-b69b-839affa1bdaa service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:50.701888 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9124c2b9-6502-45da-9f73-443bbcab3648 req-dfd48f8b-1507-4955-b69b-839affa1bdaa service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:50.702317 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9124c2b9-6502-45da-9f73-443bbcab3648 req-dfd48f8b-1507-4955-b69b-839affa1bdaa service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:50.713860 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-9124c2b9-6502-45da-9f73-443bbcab3648 req-dfd48f8b-1507-4955-b69b-839affa1bdaa service nova] Creating event network-changed:d48f3e4b-81db-4f87-98e2-6c1a0a761628 for instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 on hv-cinder-85931 Sep 28 15:45:50.719097 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-9124c2b9-6502-45da-9f73-443bbcab3648 req-dfd48f8b-1507-4955-b69b-839affa1bdaa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032800 Sep 28 15:45:50.720353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 177/346] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:51.121657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:51.125409 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:51.138743 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:51.139541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:51.143489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:51.144528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:51.144804 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:51.145567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:51.146025 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:51.146474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:51.153462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:51.154156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:51.154820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:51.155832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:51.157207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:51.158182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:51.597407 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:51.604481 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:51.605197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-50970d2b-4299-404e-98f5-4e8c8a3cc20b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1272 microversion: 2.1 time: 0.467806 Sep 28 15:45:51.605992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 178/347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:51 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1272 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:51.610281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:51.610867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:51.612241 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-36860dd3-f8d3-4e79-9909-f60307bf2792 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.500890 Sep 28 15:45:51.612979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 170/348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:51 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:51.616775 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:51.617248 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:51.617678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:51.618365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:51.618839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:51.619257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:51.749962 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:51.757780 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f66d55ee-eb76-4155-ae91-649e0eb25408 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.151043 Sep 28 15:45:51.758346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 179/349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:51 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:52.628553 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:52.629360 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:52.634328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:52.634977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:52.635338 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:52.635819 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:52.636246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:52.637039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:52.637481 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:52.637899 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:52.640922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:52.641385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:52.641810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:52.642545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:52.643005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:52.643417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:52.836402 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:52.840882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:52.844927 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e32db232-6f0c-4a61-b63a-0255e693fcd5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1272 microversion: 2.1 time: 0.220304 Sep 28 15:45:52.845578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 171/350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:52 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:52.850174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:52.850863 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:52.852421 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-79aa50b5-cd5e-488f-81a5-fe520295cca3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.221954 Sep 28 15:45:52.852984 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 180/351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:52 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:52.857754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:52.858229 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:52.858701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:52.859384 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:52.859827 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:52.860238 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:52.989446 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:52.996949 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-35f88412-0edd-4beb-aba9-65e7f0f8c55f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.150373 Sep 28 15:45:52.997511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 172/352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:52 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:53.871142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:53.872306 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:53.875130 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:53.875737 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:53.879031 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:53.879516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:53.879953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:53.880655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:53.881101 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:53.881524 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:53.881693 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:53.882178 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:53.882641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:53.883337 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:53.883775 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:53.884192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.071339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:54.078044 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:54.079467 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-88be2770-02d0-43fc-b0ec-7a2ed992f0b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1272 microversion: 2.1 time: 0.212172 Sep 28 15:45:54.080131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 181/353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:53 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:54.084538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:54.085141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:54.088454 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f601ff3e-f605-43ab-906d-dcaf3ede3477 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.217649 Sep 28 15:45:54.089248 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 173/354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:53 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:54.091459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:54.091938 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:54.092369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.093057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:54.093505 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:54.093922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.227944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:54.236298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-317d47e7-b57b-4f65-90ae-69bb48030234 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.155228 Sep 28 15:45:54.236995 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 182/355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:54 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:55.103024 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:55.103636 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:55.110054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.110564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.110998 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.111324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:55.111735 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.111927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:55.112115 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.112539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.118578 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.119050 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.119469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.120146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.120582 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.120992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.328482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:55.333058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:55.336776 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f11c25db-1db9-4258-93c7-2972f17c2e4e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.229240 Sep 28 15:45:55.337357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 183/356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:55 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:55.341793 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-9d7dc6c5-2779-49c2-917f-859cf474ce8e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1272 microversion: 2.1 time: 0.242543 Sep 28 15:45:55.342377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:55.343188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:55.345563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 174/357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:55 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:55.349464 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.349936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.350635 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.351326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.351794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.352205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.485486 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:55.493212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-10539a24-3938-4f73-98ac-be207c62af84 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.154918 Sep 28 15:45:55.493777 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 184/358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:55 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:56.363710 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:56.364296 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:56.366462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:56.367220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:56.369295 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:56.370530 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.371164 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.371648 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.372423 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.374308 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.374798 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.376228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.376771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.377200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.377903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.378356 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.378796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.566508 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:56.574061 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b01cc6b6-e53a-46d0-a538-94d7a9afe8ad tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.214561 Sep 28 15:45:56.575235 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 175/359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:56 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:56.586584 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:56.586741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:56.586741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:56.586919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-06f2d3ae-47a7-47bc-b99f-45ae45b41d84 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.222501 Sep 28 15:45:56.586919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 185/360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:56 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:56.587092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.587092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.587092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.587864 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.588315 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.588732 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.860817 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:56.868322 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a6039703-206f-4ed7-b523-7c04a51eb3e2 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.292078 Sep 28 15:45:56.868879 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 176/361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:56 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:57.599503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:57.601898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:57.607815 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:57.608547 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:57.611080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.611883 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.612710 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.613522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.613973 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.614473 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.623300 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.623989 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.624613 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.625498 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.626105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.626715 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.850492 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:57.853876 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:57.858981 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0b37c2ed-7e98-4569-86fd-16ef2fcf9f6b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1372 microversion: 2.1 time: 0.263319 Sep 28 15:45:57.859567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 186/362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:57 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:57.862283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3412d16f-40ff-4a50-af2c-3656e45e24c6 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.259649 Sep 28 15:45:57.862869 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 177/363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:57 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:57.891199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:57.891800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:57.898199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.898711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.899138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.899854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.900303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.900719 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:58.122667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:58.132311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9499a69f-9c0d-49bf-b50d-3b0286240aed tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.245004 Sep 28 15:45:58.132877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 187/364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:57 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:58.883918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:58.884526 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:58.884936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:58.885560 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:58.891096 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:58.891970 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:58.892648 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:58.893637 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:58.894369 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:58.894778 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:58.895305 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:58.895741 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:58.895988 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:58.896504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:58.896985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:58.897413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.142855 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:59.150789 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:59.154904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7f3d0dea-d9fd-4350-9a0e-a493f0ca4eff tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1567 microversion: 2.1 time: 0.276237 Sep 28 15:45:59.166445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 178/365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:58 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:59.166445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:59.166445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:59.169157 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.169695 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.170128 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.170849 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.171559 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.172165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.181263 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-52a7f95c-1964-4aa1-90a6-c174463cc792 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.299930 Sep 28 15:45:59.182513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 188/366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:58 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:59.188317 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:59.188930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:59.195471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.196351 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.197051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.198174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.198889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.199774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.205250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=100 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:59.313187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-72b51c1c-56d0-4474-882d-3e08f319edd8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129310 Sep 28 15:45:59.313799 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 189/367] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 15:45:59 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:59.353521 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:59.357807 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:59.363591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0c844cfd-a0b2-42b5-b89e-78aeef0f1bac tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.206574 Sep 28 15:45:59.364211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 179/368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:59 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:00.208676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:00.209849 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:00.216316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.217060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.217656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.218613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.219062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.219664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.389442 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:00.390057 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:00.390645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:00.400351 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d410f0b1-f5d7-4636-9d35-fedb1b1714c2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.196123 Sep 28 15:46:00.401358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 190/369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:00 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:00.405698 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.406781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.407901 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.409266 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.410129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.417552 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.446706 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-6498c984-fdb8-468a-8cfc-e29caa6d7203 req-ba61d36b-4a34-401f-8328-31577b53e34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bcecf7-6cc5-461e-a267-0c215dacf388", "tag": "649b2c71-9e63-43df-99c9-186b4043bdb6"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:00.460375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6498c984-fdb8-468a-8cfc-e29caa6d7203 req-ba61d36b-4a34-401f-8328-31577b53e34f service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.461150 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6498c984-fdb8-468a-8cfc-e29caa6d7203 req-ba61d36b-4a34-401f-8328-31577b53e34f service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.461660 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6498c984-fdb8-468a-8cfc-e29caa6d7203 req-ba61d36b-4a34-401f-8328-31577b53e34f service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.476342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-6498c984-fdb8-468a-8cfc-e29caa6d7203 req-ba61d36b-4a34-401f-8328-31577b53e34f service nova] Creating event network-changed:649b2c71-9e63-43df-99c9-186b4043bdb6 for instance 13bcecf7-6cc5-461e-a267-0c215dacf388 on hv-cinder-85931 Sep 28 15:46:00.482904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-6498c984-fdb8-468a-8cfc-e29caa6d7203 req-ba61d36b-4a34-401f-8328-31577b53e34f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039989 Sep 28 15:46:00.484189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 191/370] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:00.589836 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:00.597754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cef47ae0-7ba6-4e64-85d0-47ba32726f8b tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.214067 Sep 28 15:46:00.611388 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 180/371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:00 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:01.431891 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:01.434198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:01.443086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.443958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.444642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.445508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.446108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.446707 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.624428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:01.625117 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:01.635103 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.639400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.639840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.640585 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.641031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.644686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.704803 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:01.718566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dbcc52ce-7d8e-480b-8b4b-ee88729c660b tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.293955 Sep 28 15:46:01.719553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 192/372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:01 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:01.892750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:01.904152 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-77823f5d-83c1-4533-aed3-8493f6dad101 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.285127 Sep 28 15:46:01.920748 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 181/373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:01 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:02.744079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:02.744674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:02.761259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:02.762394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:02.763161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:02.764090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:02.764741 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:02.765346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:02.928419 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:02.929813 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:02.953744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:02.956104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:02.959121 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:02.961354 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:02.962794 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:02.963542 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:02.993018 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:03.005542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-83777a7d-0ef0-4ff9-87a9-a0a1008516f5 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.267208 Sep 28 15:46:03.019218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 193/374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:02 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:03.157860 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:03.173717 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5315628a-ff68-4cc8-a51b-6b2a7407f7cc tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.248704 Sep 28 15:46:03.183944 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 182/375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:02 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:04.031177 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:04.032005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:04.049148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:04.053259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:04.054010 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:04.054884 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:04.055736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:04.056810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:04.196898 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:04.197828 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:04.208285 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:04.208893 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:04.209437 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:04.210123 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:04.214253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:04.214253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:04.257715 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:04.268413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-510b3345-6f0f-4dfa-b8ad-35353069333d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.241812 Sep 28 15:46:04.270826 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 194/376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:04 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:04.399666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:04.410200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-91dc65a5-3aae-47b4-b9f5-f2dbe288eefa tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.216138 Sep 28 15:46:04.421918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 183/377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:04 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:05.293800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:05.294564 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:05.302595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:05.303364 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:05.304039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:05.305184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:05.306106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:05.307522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:05.434107 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:05.434758 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:05.444007 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:05.446789 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:05.449807 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:05.451261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:05.452902 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:05.453562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:05.831997 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:05.835821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:05.846272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f4b73711-4f0e-4828-82db-00f26305aef0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.556744 Sep 28 15:46:05.847433 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 195/378] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:05 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:05.865800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-92eb6506-c5b8-4444-b48b-2cd359648006 req-f681c97c-f910-4137-9c16-5623a25c1024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b079b76c-a25b-4945-9ea6-b614c2b5aae7", "name": "network-vif-plugged", "status": "completed", "tag": "d48f3e4b-81db-4f87-98e2-6c1a0a761628"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:05.869123 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4865526f-a24d-4d9a-a369-90e16cac009f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.439781 Sep 28 15:46:05.882442 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 184/379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:05 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:05.890168 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-92eb6506-c5b8-4444-b48b-2cd359648006 req-f681c97c-f910-4137-9c16-5623a25c1024 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:05.891128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-92eb6506-c5b8-4444-b48b-2cd359648006 req-f681c97c-f910-4137-9c16-5623a25c1024 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:05.891728 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-92eb6506-c5b8-4444-b48b-2cd359648006 req-f681c97c-f910-4137-9c16-5623a25c1024 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:05.906796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-92eb6506-c5b8-4444-b48b-2cd359648006 req-f681c97c-f910-4137-9c16-5623a25c1024 service nova] Creating event network-vif-plugged:d48f3e4b-81db-4f87-98e2-6c1a0a761628 for instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 on hv-cinder-85931 Sep 28 15:46:05.913802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-92eb6506-c5b8-4444-b48b-2cd359648006 req-f681c97c-f910-4137-9c16-5623a25c1024 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064404 Sep 28 15:46:05.915272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 196/380] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:06.871209 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:06.871865 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:06.878523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:06.879010 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:06.879457 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:06.880150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:06.880600 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:06.881041 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:06.898396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:06.899157 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:06.910487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:06.911069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:06.911550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:06.912357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:06.912838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:06.915081 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:07.138666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:07.142837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:07.153832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4dc3ff72-753c-4417-8e2d-c9c945c14fbe tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1314 microversion: 2.1 time: 0.260610 Sep 28 15:46:07.156748 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6fc2f97c-e534-4782-98ec-57076737ab6a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.289351 Sep 28 15:46:07.167391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 197/381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:06 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:07.175459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 185/382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:06 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:08.182570 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:08.182570 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:08.187174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:08.187664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:08.188088 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:08.188793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:08.189241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:08.189654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:08.190188 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:08.191461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:08.201635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:08.203460 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:08.204078 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:08.204816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:08.205288 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:08.205707 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:08.521280 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:08.536251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:08.537860 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e51cc3c0-c227-4d6f-9b89-373f14b2e1d1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1497 microversion: 2.1 time: 0.360974 Sep 28 15:46:08.540556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 198/383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:08 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1497 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:08.553227 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-410d87dc-3047-4e0b-9770-16f0c21afd24 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.373420 Sep 28 15:46:08.563514 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 186/384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:08 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:09.362792 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:09.363581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:09.371529 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:09.372094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:09.372600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.373373 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:09.373898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:09.374388 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.428263 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:46:09.531753 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dce2b715-edd9-42e8-b5e0-198e5f621258 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 204 len: 0 microversion: 2.1 time: 0.172694 Sep 28 15:46:09.533047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 199/385] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:46:09 2022] DELETE /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:46:09.541978 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:09.542648 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:09.549560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:09.550136 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:09.550767 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.551674 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:09.552277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:09.552932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.593742 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:09.595575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:09.606287 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:09.619396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:09.620397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.621372 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:09.631147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:09.631834 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.832587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:09.851922 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4bc93b5d-9e21-4ea9-94c9-3798e3335ce1 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1503 microversion: 2.1 time: 0.314204 Sep 28 15:46:09.883716 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 187/386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:09 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:09.962892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:09.977787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-eaa93d66-23ed-4b67-8410-451463369546 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.391104 Sep 28 15:46:09.978722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 200/387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:09 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:10.136358 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-140cf97e-da2b-426a-a34f-0a5954942bb6 req-133ded95-5108-4002-83a8-6b9119536594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc8195d-c5bd-4e78-9001-13215dfedb9c", "name": "network-vif-plugged", "status": "completed", "tag": "6fe3578e-1526-411a-a9b7-3e91f28a36fb"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:10.166339 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-140cf97e-da2b-426a-a34f-0a5954942bb6 req-133ded95-5108-4002-83a8-6b9119536594 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:10.167129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-140cf97e-da2b-426a-a34f-0a5954942bb6 req-133ded95-5108-4002-83a8-6b9119536594 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:10.168239 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-140cf97e-da2b-426a-a34f-0a5954942bb6 req-133ded95-5108-4002-83a8-6b9119536594 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:10.191652 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-140cf97e-da2b-426a-a34f-0a5954942bb6 req-133ded95-5108-4002-83a8-6b9119536594 service nova] Creating event network-vif-plugged:6fe3578e-1526-411a-a9b7-3e91f28a36fb for instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c on hv-cinder-85931 Sep 28 15:46:10.200295 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-140cf97e-da2b-426a-a34f-0a5954942bb6 req-133ded95-5108-4002-83a8-6b9119536594 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073855 Sep 28 15:46:10.201218 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 188/388] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:46:10.896710 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:10.897339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:10.915467 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:10.915973 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:10.916412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:10.917126 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:10.917617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:10.918039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:11.009342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:11.010697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:11.031191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:11.032136 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:11.033594 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:11.036649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:11.039151 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:11.043028 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:11.202233 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:11.213965 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7cddb6c0-eafb-4924-b6bf-0a196c92f1e3 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1503 microversion: 2.1 time: 0.322108 Sep 28 15:46:11.215652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 201/389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:10 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1503 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:11.311898 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:11.320024 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e244b3e6-854c-4b98-8aef-06f31efd52b4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.318871 Sep 28 15:46:11.321154 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 189/390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:10 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:12.237514 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:12.238062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:12.256053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:12.256736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:12.257106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:12.257991 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:12.263546 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-ab351c12-3639-4159-af89-963a458ed627 req-5a68b5da-1ba4-495d-85ae-e030a8f348ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b079b76c-a25b-4945-9ea6-b614c2b5aae7", "name": "network-vif-deleted", "tag": "d48f3e4b-81db-4f87-98e2-6c1a0a761628"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:12.266283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:12.267093 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:12.275294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ab351c12-3639-4159-af89-963a458ed627 req-5a68b5da-1ba4-495d-85ae-e030a8f348ca service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:12.276043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ab351c12-3639-4159-af89-963a458ed627 req-5a68b5da-1ba4-495d-85ae-e030a8f348ca service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:12.277142 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ab351c12-3639-4159-af89-963a458ed627 req-5a68b5da-1ba4-495d-85ae-e030a8f348ca service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:12.317308 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-ab351c12-3639-4159-af89-963a458ed627 req-5a68b5da-1ba4-495d-85ae-e030a8f348ca service nova] Creating event network-vif-deleted:d48f3e4b-81db-4f87-98e2-6c1a0a761628 for instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 on hv-cinder-85931 Sep 28 15:46:12.327262 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-ab351c12-3639-4159-af89-963a458ed627 req-5a68b5da-1ba4-495d-85ae-e030a8f348ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076270 Sep 28 15:46:12.328403 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 190/391] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:12.346303 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:12.347724 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:12.381106 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:12.381829 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:12.382448 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:12.383960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:12.384832 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:12.385475 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:12.400095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:12.409441 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f5cc7871-4edd-4098-b33f-5008dba02c4d tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1461 microversion: 2.1 time: 0.175780 Sep 28 15:46:12.410385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 202/392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:12 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1461 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:12.576402 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:12.590730 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-845cf752-6bc4-489d-ab8f-c8b17d5dc362 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1260 microversion: 2.1 time: 0.246434 Sep 28 15:46:12.608153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 191/393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:12 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1260 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:13.110362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-891ea7b2-9946-4beb-9618-1d1b284b2f16 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Action: 'create', calling method: .version_select at 0x7f8fd09fec10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1385565331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAajxn0A7u5/ZyGcKXmkOJHAeV7/xW1AGKVkYJn+NJPDkbf3OEIjdtODiAnpzkpVCVIKX1+kjjh5VpmOXn96kWKzSctNWP5v9ymKlEYwr8swvuke+oJ1o7UM6PkHPd4pVg=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:13.127061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-891ea7b2-9946-4beb-9618-1d1b284b2f16 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Getting quotas for project bcffff710dd74209b30a1d02fb2bec46. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:13.133508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-891ea7b2-9946-4beb-9618-1d1b284b2f16 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Getting quotas for user 88f34e4fc44e432d9e994ae5dcdbd1ae and project bcffff710dd74209b30a1d02fb2bec46. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:13.164536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-891ea7b2-9946-4beb-9618-1d1b284b2f16 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.257744 Sep 28 15:46:13.165568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 203/394] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 15:46:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:13.439324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:13.440772 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:13.458193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.458923 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.459518 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.460903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.461530 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.462114 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.506053 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.506897 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.507497 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.508137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lazy-loading 'fault' on Instance uuid b079b76c-a25b-4945-9ea6-b614c2b5aae7 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:13.574099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0da6e03372642b8b2ee06780cd03714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff0f334384454c7daba615e52ce21cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:13.583725 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d1904fb6-0583-4845-8aba-d95ea86fc720 tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 200 len: 1304 microversion: 2.1 time: 0.152245 Sep 28 15:46:13.586773 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 192/395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:13 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:13.614548 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:13.615046 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:13.625198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.625682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.626380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.627182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.627665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.628139 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.820442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:13.836352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4166fd50-f7b7-4baf-aa2a-f3af65b5bf94 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1445 microversion: 2.1 time: 0.225835 Sep 28 15:46:13.842937 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 204/396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:13 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1445 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:13.863063 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:13.863670 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:13.870127 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.870684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.871110 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.871890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.872395 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.873181 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:14.063422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:14.071787 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f03e925f-be57-4df0-9e89-457dedddbabc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1445 microversion: 2.1 time: 0.212769 Sep 28 15:46:14.072372 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 193/397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:13 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1445 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:14.610402 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:14.611296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] [instance: b079b76c-a25b-4945-9ea6-b614c2b5aae7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:14.619360 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:14.623605 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:14.624267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:14.625251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:14.625852 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:14.626660 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:14.650087 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] HTTP exception thrown: Instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 could not be found. Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Request method failure captured: Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 HTTP/1.1 Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGv0LXpGL-NQ0YuWd02c-AknluWIrWwBZKMuIEYSXP6tmrIX_kDKQ8dTOCppjModoIyOiK4xm2j-05arNJdPSrmdmcKXsR8AJo1dW-mNo6NJ-ARO67G9-hRKBtmBX4CemyN3z6I0nhnvD04SusOHFVnmsJS0NyuH6FwrPsK4CasgcE0 Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: ff0f334384454c7daba615e52ce21cd1 Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesActionsTest-1174248459 Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:46:14.651903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ff0f334384454c7daba615e52ce21cd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ff0f334384454c7daba615e52ce21cd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ff0f334384454c7daba615e52ce21cd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ff0f334384454c7daba615e52ce21cd1"}]}] Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesActionsTest-1174248459 Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: ff0f334384454c7daba615e52ce21cd1 Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesActionsTest-1174248459 Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesActionsTest-1174248459-project Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: b0da6e03372642b8b2ee06780cd03714 Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesActionsTest-1174248459-project Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 could not be found. Sep 28 15:46:14.653540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'b079b76c-a25b-4945-9ea6-b614c2b5aae7'} Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 could not be found. Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:46:14.654452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 could not be found. Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 could not be found. Sep 28 15:46:14.656004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:46:14.657228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] Returning 404 to user: Instance b079b76c-a25b-4945-9ea6-b614c2b5aae7 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:46:14.657228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1ce1ffb2-c956-4bc5-919d-395be7f0f00f tempest-VolumesActionsTest-1174248459 tempest-VolumesActionsTest-1174248459-project] 10.222.0.60 "GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7" status: 404 len: 111 microversion: 2.1 time: 0.047818 Sep 28 15:46:14.657651 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 205/398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:14 2022] GET /compute/v2.1/servers/b079b76c-a25b-4945-9ea6-b614c2b5aae7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:46:16.701269 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-54757dae-59be-427f-9281-c3f3565dc7af req-9a0e28a4-6b46-4b36-bfe5-a59975e73324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc8195d-c5bd-4e78-9001-13215dfedb9c", "tag": "6fe3578e-1526-411a-a9b7-3e91f28a36fb"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:16.718257 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-54757dae-59be-427f-9281-c3f3565dc7af req-9a0e28a4-6b46-4b36-bfe5-a59975e73324 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:16.720727 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-54757dae-59be-427f-9281-c3f3565dc7af req-9a0e28a4-6b46-4b36-bfe5-a59975e73324 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:16.721281 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-54757dae-59be-427f-9281-c3f3565dc7af req-9a0e28a4-6b46-4b36-bfe5-a59975e73324 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:16.739677 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-54757dae-59be-427f-9281-c3f3565dc7af req-9a0e28a4-6b46-4b36-bfe5-a59975e73324 service nova] Creating event network-changed:6fe3578e-1526-411a-a9b7-3e91f28a36fb for instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c on hv-cinder-85931 Sep 28 15:46:16.745245 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-54757dae-59be-427f-9281-c3f3565dc7af req-9a0e28a4-6b46-4b36-bfe5-a59975e73324 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048649 Sep 28 15:46:16.746209 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 194/399] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:57.104536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1324830052", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1385565331", "security_groups": [{"name": "tempest-secgroup-smoke-714818131"}], "block_device_mapping_v2": [{"uuid": "ea401450-af6a-4323-9990-ee6b1c7456e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6eae24b-3c95-4cde-9586-a8891b23b1a7"}]}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:57.116276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:57.117138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:57.117668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:57.239452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] validate_networks() for [('b6eae24b-3c95-4cde-9586-a8891b23b1a7', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:46:57.660716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:46:57.661137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:46:57.661718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:46:57.662187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:46:57.662695 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:46:57.672969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:57.673698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:57.674226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:57.675052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:57.675716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:57.676405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:57.705766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Getting quotas for project bcffff710dd74209b30a1d02fb2bec46. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:57.711502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Getting quotas for user 88f34e4fc44e432d9e994ae5dcdbd1ae and project bcffff710dd74209b30a1d02fb2bec46. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:57.774937 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:46:57.777108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea401450-af6a-4323-9990-ee6b1c7456e2',volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:46:57.915771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b767635d-957a-4e28-92e4-c16646c9d64e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.815264 Sep 28 15:46:57.916418 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 206/400] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:46:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:46:57.925957 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=53 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:57.926719 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=80 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:57.932014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c3b2a84d-d667-4516-b8f0-419e9d5e1a7d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:57.932744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c3b2a84d-d667-4516-b8f0-419e9d5e1a7d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:57.989129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c3b2a84d-d667-4516-b8f0-419e9d5e1a7d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:57.996116 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c3b2a84d-d667-4516-b8f0-419e9d5e1a7d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1095 microversion: 2.1 time: 0.071597 Sep 28 15:46:57.996683 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 195/401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:57 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:59.020137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:59.020665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:59.027374 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:59.027853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:59.028279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:59.028964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:59.029406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:59.029823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:59.095021 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:59.102668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0770e1a6-1d6e-4e34-a7cd-85ba8333f909 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1145 microversion: 2.1 time: 0.087526 Sep 28 15:46:59.103218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 207/402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:59 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:00.124673 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:00.125289 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:00.132635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:00.133405 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:00.133555 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:00.134250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:00.134735 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:00.135158 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:00.198432 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:00.206686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d11bb7fb-10c7-40e5-b487-41260bf3a3af tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1145 microversion: 2.1 time: 0.086317 Sep 28 15:47:00.207254 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 196/403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:00 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:01.229020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:01.229646 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:01.236503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:01.236972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:01.237428 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:01.238098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:01.238583 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:01.238993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:01.301784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:01.309598 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d600c55a-899a-4eb1-9ae2-16aa5a2969e4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1145 microversion: 2.1 time: 0.084453 Sep 28 15:47:01.310151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 208/404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:01 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:02.332605 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:02.333205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:02.339512 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:02.339985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:02.340585 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:02.341213 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:02.341654 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:02.342088 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:02.427166 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:02.438027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0c2d36e1-67c5-42bf-918c-64bb3f7f6327 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1211 microversion: 2.1 time: 0.110354 Sep 28 15:47:02.438660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 197/405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:02 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:03.461371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:03.462034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:03.469376 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:03.469853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:03.470276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:03.471005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:03.471448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:03.471864 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:03.701300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:03.710359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-866100f8-5de7-41e7-830e-8fe0421c92b4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.252914 Sep 28 15:47:03.711059 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 209/406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:03 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:04.181928 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-ba224545-767a-427a-9245-123a3729bceb req-a811f431-8a9d-4c2b-bb77-241b34ae1d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a8645e-d57d-45ff-b0e3-686164f46a86", "tag": "bc6cda45-9454-4e0f-b2fb-990cfe8f3cfa"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:04.192105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ba224545-767a-427a-9245-123a3729bceb req-a811f431-8a9d-4c2b-bb77-241b34ae1d04 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:04.192578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ba224545-767a-427a-9245-123a3729bceb req-a811f431-8a9d-4c2b-bb77-241b34ae1d04 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:04.193006 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ba224545-767a-427a-9245-123a3729bceb req-a811f431-8a9d-4c2b-bb77-241b34ae1d04 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:04.204229 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-ba224545-767a-427a-9245-123a3729bceb req-a811f431-8a9d-4c2b-bb77-241b34ae1d04 service nova] Creating event network-changed:bc6cda45-9454-4e0f-b2fb-990cfe8f3cfa for instance 31a8645e-d57d-45ff-b0e3-686164f46a86 on hv-cinder-85931 Sep 28 15:47:04.209332 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-ba224545-767a-427a-9245-123a3729bceb req-a811f431-8a9d-4c2b-bb77-241b34ae1d04 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031338 Sep 28 15:47:04.210090 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 198/407] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:04.733091 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:04.733727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:04.740165 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:04.740648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:04.741075 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:04.741751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:04.742194 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:04.742645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:04.871877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:04.879765 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b4eee54d-6a5e-4b38-aa09-0c6452e834f5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.150462 Sep 28 15:47:04.880349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 210/408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:04 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:05.903315 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:05.904033 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:05.910675 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:05.911145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:05.911567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:05.912237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:05.912673 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:05.913083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:06.042870 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:06.051041 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-9d25ae92-7ee6-4870-913a-5024b3f362bb tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.151980 Sep 28 15:47:06.051612 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 199/409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:05 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:07.073774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:07.074375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:07.080693 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:07.081174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:07.081597 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:07.082268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:07.082733 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:07.083147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:07.215983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:07.223677 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2b566ee2-09fe-478c-a600-42218bcfe6b9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.153738 Sep 28 15:47:07.224234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 211/410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:07 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:08.246631 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:08.247308 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:08.250119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:08.255905 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:08.256379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:08.256799 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:08.257490 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:08.257928 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:08.258368 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:08.390207 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:08.397766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f7754a79-9381-4d4a-b04c-950b80881dc4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.155057 Sep 28 15:47:08.398313 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 200/411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:08 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:09.420344 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:09.420960 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:09.422819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:09.423500 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=6 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:09.429844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.430329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.430783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.431735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.432182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.432603 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.570161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:09.578432 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4ab9e5d6-91fd-4213-87cf-271aabe4a8d9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.161915 Sep 28 15:47:09.578992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 212/412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:09 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:10.601055 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:10.601649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:10.607698 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:10.608796 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:10.609241 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:10.609909 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:10.610378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:10.610820 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:10.751454 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:10.761338 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-af4681da-44ca-41dc-a794-7fec8163d9ea tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.164166 Sep 28 15:47:10.762145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 201/413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:10 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:11.784941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:11.785542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:11.791983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:11.792468 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:11.792901 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:11.793584 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:11.794034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:11.794476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:11.923448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:11.931273 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2c6023bd-25ec-4a95-9ad6-bf9da1720be4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.150202 Sep 28 15:47:11.932099 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 213/414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:11 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:12.953883 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:12.954513 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:12.960776 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:12.961249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:12.961680 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:12.962367 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:12.962843 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:12.963265 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:13.094872 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:13.102596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c75578d6-b356-4b6c-aa11-d2dfea6514fd tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.152513 Sep 28 15:47:13.103159 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 202/415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:12 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:14.126275 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:14.126908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:14.133377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:14.133837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:14.134265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:14.134980 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:14.135430 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:14.135855 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:14.269136 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:14.276948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6ce58c99-6d2a-4481-a031-696693145767 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.154996 Sep 28 15:47:14.277518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 214/416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:14 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:15.299280 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:15.299906 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:15.305892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:15.306668 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:15.307108 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:15.307806 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:15.308255 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:15.308674 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:15.455442 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:15.463026 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-418114fd-84d9-4b80-b6a2-9f0427577cbc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.167520 Sep 28 15:47:15.463505 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 203/417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:15 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:16.486404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:16.487015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:16.493398 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:16.493965 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:16.494304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:16.495013 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:16.495461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:16.495880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:16.627959 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:16.636133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d46a06e7-cf38-43fb-9de0-86fe68397316 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.154061 Sep 28 15:47:16.636710 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 215/418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:16 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:17.659491 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:17.660086 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:17.666225 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:17.666735 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:17.667163 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:17.667848 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:17.668293 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:17.668712 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:17.806547 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:17.814266 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c9b08370-3d1e-4003-b749-e1ce0a1b7df4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.158604 Sep 28 15:47:17.814852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 204/419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:17 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:18.838791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:18.839848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:18.849016 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:18.849523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:18.850051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:18.850864 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:18.851316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:18.851738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:19.005557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:19.013701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9a926710-d2fa-4227-8222-f22cd6c4077e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.180110 Sep 28 15:47:19.014361 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 216/420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:18 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:20.036689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:20.037268 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:20.043642 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:20.044107 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:20.044790 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:20.045474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:20.045917 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:20.046330 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:20.185200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:20.193861 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-25b713fd-5078-460f-a20d-2c421fd16916 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.160891 Sep 28 15:47:20.194486 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 205/421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:20 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:20.293055 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-2a45b5df-1ac4-4536-b61a-206c90020d23 req-64ab08df-9502-4543-b4bb-7d77730dabe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a8645e-d57d-45ff-b0e3-686164f46a86", "name": "network-vif-plugged", "status": "completed", "tag": "bc6cda45-9454-4e0f-b2fb-990cfe8f3cfa"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:20.304170 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2a45b5df-1ac4-4536-b61a-206c90020d23 req-64ab08df-9502-4543-b4bb-7d77730dabe8 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:20.304676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2a45b5df-1ac4-4536-b61a-206c90020d23 req-64ab08df-9502-4543-b4bb-7d77730dabe8 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:20.305265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2a45b5df-1ac4-4536-b61a-206c90020d23 req-64ab08df-9502-4543-b4bb-7d77730dabe8 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:20.317362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-2a45b5df-1ac4-4536-b61a-206c90020d23 req-64ab08df-9502-4543-b4bb-7d77730dabe8 service nova] Creating event network-vif-plugged:bc6cda45-9454-4e0f-b2fb-990cfe8f3cfa for instance 31a8645e-d57d-45ff-b0e3-686164f46a86 on hv-cinder-85931 Sep 28 15:47:20.325553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-2a45b5df-1ac4-4536-b61a-206c90020d23 req-64ab08df-9502-4543-b4bb-7d77730dabe8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Sep 28 15:47:20.326352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 217/422] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:21.216819 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:21.217532 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:21.223375 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:21.223851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:21.224280 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:21.224952 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:21.225396 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:21.225814 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:21.362203 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:21.369980 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d376261d-3309-4eb6-977e-50f550934ff9 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1266 microversion: 2.1 time: 0.156973 Sep 28 15:47:21.370615 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 206/423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:21 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:22.394908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:22.395595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:22.401590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:22.402134 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:22.402658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:22.403424 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:22.403928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:22.404413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:22.549129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:22.557645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ee9872b9-5ce6-4f7f-85a9-b312290f3fe5 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1453 microversion: 2.1 time: 0.168058 Sep 28 15:47:22.558219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 218/424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:22 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:22.582645 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:22.583288 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:22.589649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:22.590143 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:22.590597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:22.591308 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:22.591754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:22.592172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:22.738281 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:22.746122 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-045db1fc-6fd2-4204-b23f-93f0f086bc94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1453 microversion: 2.1 time: 0.168011 Sep 28 15:47:22.746713 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 207/425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:22 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:24.914421 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-1933eff1-df7c-4dd7-ab7c-1b843acc31e1 req-479aa781-9fcd-45c0-b833-14358d2911d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a8645e-d57d-45ff-b0e3-686164f46a86", "tag": "bc6cda45-9454-4e0f-b2fb-990cfe8f3cfa"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:24.924267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-1933eff1-df7c-4dd7-ab7c-1b843acc31e1 req-479aa781-9fcd-45c0-b833-14358d2911d9 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:24.924757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-1933eff1-df7c-4dd7-ab7c-1b843acc31e1 req-479aa781-9fcd-45c0-b833-14358d2911d9 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:24.925160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-1933eff1-df7c-4dd7-ab7c-1b843acc31e1 req-479aa781-9fcd-45c0-b833-14358d2911d9 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:24.939793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-1933eff1-df7c-4dd7-ab7c-1b843acc31e1 req-479aa781-9fcd-45c0-b833-14358d2911d9 service nova] Creating event network-changed:bc6cda45-9454-4e0f-b2fb-990cfe8f3cfa for instance 31a8645e-d57d-45ff-b0e3-686164f46a86 on hv-cinder-85931 Sep 28 15:47:24.944641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-1933eff1-df7c-4dd7-ab7c-1b843acc31e1 req-479aa781-9fcd-45c0-b833-14358d2911d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033879 Sep 28 15:47:24.945266 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 219/426] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:47:31.534960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:31.535674 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:31.538314 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=29 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:31.544156 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:31.544636 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:31.545068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:31.545759 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:31.546219 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:31.546666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:31.549929 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=69 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:31.571426 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d472ebbf-26b7-4e55-8a19-f39d3a05333c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/ips" status: 200 len: 151 microversion: 2.20 time: 0.041468 Sep 28 15:47:31.571993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 208/427] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 28 15:47:31 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:47:33.450516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:33.451121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:33.453576 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:33.459726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:33.460201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:33.460619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:33.461306 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:33.461738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:33.462152 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:33.465071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=73 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:33.486265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lazy-loading 'flavor' on Instance uuid e1b859de-bccb-472f-ab94-ede851f23b9a {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:47:33.711731 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c0ab697b-51d3-458b-9301-5f749294a94f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/action" status: 202 len: 0 microversion: 2.20 time: 0.265861 Sep 28 15:47:33.712264 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 220/428] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 28 15:47:33 2022] POST /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:47:33.721390 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:33.721993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:33.728725 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:33.729174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:33.729626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:33.730345 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:33.731047 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:33.731478 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:33.873685 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:33.882858 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:33.884323 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:33.885488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b88da2da-e6a5-4099-950f-c37a36a8c42d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.168216 Sep 28 15:47:33.886044 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 209/429] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:33 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:34.912559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:34.913251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:34.920249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:34.920733 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:34.921167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:34.921883 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:34.922331 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:34.922778 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:35.050265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:35.058761 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:35.060230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:35.061388 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-45f5aca2-e962-45fd-a720-3248654ad751 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.153587 Sep 28 15:47:35.062690 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 221/430] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:34 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:36.087390 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:36.088021 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:36.094604 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:36.095083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:36.095511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:36.096190 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:36.096635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:36.097089 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:36.225504 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:36.233400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:36.234979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:36.236110 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0a0eb510-3a7e-44ac-a807-1c15f40994eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.152673 Sep 28 15:47:36.236650 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 210/431] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:36 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:37.260914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:37.261544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:37.268035 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:37.268516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:37.268949 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:37.269647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:37.270139 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:37.270673 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:37.400561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:37.409154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:37.410642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:37.411825 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-32bde161-1204-4d74-8cce-5a53e015e92b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.154771 Sep 28 15:47:37.412391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 222/432] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:37 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:38.437967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:38.438658 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:38.444726 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:38.445198 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:38.445620 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:38.446395 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:38.446868 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:38.447277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:38.581655 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:38.589920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:38.591401 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:38.592564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-08285cb8-dc16-4567-b552-82e8e95a7a09 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.159164 Sep 28 15:47:38.593134 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 211/433] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:38 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:39.621051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:39.621617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:39.628381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:39.628855 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:39.629277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:39.629957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:39.630395 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:39.630836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:39.761525 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:39.769972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:39.771459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:39.772655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-19f716b2-674c-456b-ba8d-65d3685e68d6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.155676 Sep 28 15:47:39.773219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 223/434] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:39 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:40.799280 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:40.799919 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:40.805806 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:40.806560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:40.806988 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:40.807669 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:40.808108 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:40.808516 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:40.938684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:40.946788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:40.948246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:40.949427 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c11111dd-ac7d-4d53-93a0-d3e127727b80 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.154546 Sep 28 15:47:40.950009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 212/435] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:40 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:41.973682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:41.974374 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:41.981265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:41.981727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:41.982156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:41.982879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:41.983324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:41.983749 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:42.112493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:42.124450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:42.126571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:42.127922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6cb9374e-7c5e-4704-9428-72a1fd9c5782 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.158142 Sep 28 15:47:42.128302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 224/436] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:41 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:43.153925 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:43.154543 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:43.161228 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:43.161694 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:43.162116 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:43.162821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:43.163263 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:43.163779 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:43.428423 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:43.437299 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:43.439390 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:43.440560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b270b9cc-f893-49aa-99cf-ea750ae9a627 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.290553 Sep 28 15:47:43.441103 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 213/437] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:43 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:47:44.466536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:44.467221 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:44.475912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:44.476473 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:44.476954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:44.477726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:44.478236 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:44.478775 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:44.817123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:44.825642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:44.827198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:44.829067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c533a297-2153-4688-9783-fea78e2b659e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.365833 Sep 28 15:47:44.829658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 225/438] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:44 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:45.856675 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:45.858035 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:45.864589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:45.865430 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:45.866073 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:45.867053 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:45.868172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:45.868806 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:46.089134 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:46.110792 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:46.112315 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:46.113558 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5d8fef60-e0af-4f16-8d6e-72d03b2e7d8c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1744 microversion: 2.20 time: 0.263085 Sep 28 15:47:46.114129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 214/439] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:45 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1744 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:47.148202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:47.148842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:47.155813 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.156828 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.157263 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.157963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.158424 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.159589 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.344082 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:47.357160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:47.366096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:47.367366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-868e5ca9-8fd5-47c4-b13b-07b51eca1e04 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1744 microversion: 2.20 time: 0.223534 Sep 28 15:47:47.368135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 226/440] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:47 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:48.396335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:48.397584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:48.412582 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:48.413446 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:48.413581 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:48.414181 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:48.414668 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:48.415871 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:48.632170 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:48.645216 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:48.647341 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:48.648804 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-97eb5a87-5010-45e5-a3a2-ee627296a6c8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1744 microversion: 2.20 time: 0.259452 Sep 28 15:47:48.649467 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 215/441] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:48 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1744 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:49.675954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:49.676565 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:49.683068 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:49.683543 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:49.683963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:49.684640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:49.685077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:49.685482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:49.841025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:49.850341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:49.852116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:49.853284 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2a861971-a52f-49cf-90d8-d7ad61ca549f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1744 microversion: 2.20 time: 0.181389 Sep 28 15:47:49.853835 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 227/442] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:49 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:50.686762 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-a0ff21ba-5c8f-4e8d-b874-653c68f0484d req-9ab876da-4672-4d8b-b211-5997fe90bac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b859de-bccb-472f-ab94-ede851f23b9a", "name": "network-vif-plugged", "status": "completed", "tag": "e54cc8ad-2191-4813-9924-f40b092980cc"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:50.699979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-a0ff21ba-5c8f-4e8d-b874-653c68f0484d req-9ab876da-4672-4d8b-b211-5997fe90bac0 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.700512 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-a0ff21ba-5c8f-4e8d-b874-653c68f0484d req-9ab876da-4672-4d8b-b211-5997fe90bac0 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.701201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-a0ff21ba-5c8f-4e8d-b874-653c68f0484d req-9ab876da-4672-4d8b-b211-5997fe90bac0 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.714043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-a0ff21ba-5c8f-4e8d-b874-653c68f0484d req-9ab876da-4672-4d8b-b211-5997fe90bac0 service nova] Creating event network-vif-plugged:e54cc8ad-2191-4813-9924-f40b092980cc for instance e1b859de-bccb-472f-ab94-ede851f23b9a on hv-cinder-85931 Sep 28 15:47:50.719827 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-a0ff21ba-5c8f-4e8d-b874-653c68f0484d req-9ab876da-4672-4d8b-b211-5997fe90bac0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037110 Sep 28 15:47:50.720563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 216/443] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:50.882631 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:50.884977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:50.901048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.902092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.902775 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.903706 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.904360 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.905131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:51.112176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:51.123334 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:51.125181 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:51.126970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1a6dc7ec-2081-4663-9ae9-07cbf1830f25 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1744 microversion: 2.20 time: 0.252282 Sep 28 15:47:51.128050 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 228/444] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:50 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1744 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:47:52.159241 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:52.160090 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:52.185100 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:52.185688 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:52.186131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:52.186896 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:52.187398 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:52.187823 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:52.533597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:52.561788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:52.573274 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:52.579392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0e5d92c3-806f-4526-9b2e-75293134603b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.424310 Sep 28 15:47:52.580064 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 217/445] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:52 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:53.612143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:53.612684 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:53.626814 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:53.627513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:53.628133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:53.631817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:53.632504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:53.633099 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:53.946737 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:53.960419 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:53.961855 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:53.971348 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9a8499c0-2162-4602-98c6-7e6eb15e3ab3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.363751 Sep 28 15:47:53.972556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 229/446] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:53 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:55.000973 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:55.002268 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:55.015483 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:55.016374 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:55.017059 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:55.019707 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:55.020224 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:55.021360 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:55.209237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:55.218325 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:55.220782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:55.222468 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a35c7347-8c5c-404e-a247-fa6dfcae429f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.226126 Sep 28 15:47:55.237421 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 218/447] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:54 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:56.250363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:56.251089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:56.262112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.262353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.265623 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.275664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.276185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.277378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.509882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:56.521900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:56.533629 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:56.548485 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-445ad4de-cb9d-4de1-9a07-498ebd5716bc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.302351 Sep 28 15:47:56.549410 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 230/448] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:56 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:57.579054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:57.579644 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:57.587618 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:57.588113 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:57.588538 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:57.589231 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:57.589673 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:57.590090 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:57.822224 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:57.834664 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:57.836461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:57.839771 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f517a7fd-d6bc-4808-8a2d-19b0fe937647 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.265270 Sep 28 15:47:57.843163 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 219/449] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:57 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:58.869841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:58.870647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:58.886808 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:58.891658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:58.892204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:58.892953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:58.897721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:58.898261 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:59.163942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:59.176838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:59.178390 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:59.181385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-540afa08-7fbc-47bc-80ba-9fb5976a2a90 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.314569 Sep 28 15:47:59.182821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 231/450] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:58 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:59.920833 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5abbdf1f-d1aa-400f-a0d1-abf8607b3fa4"}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:59.924235 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:59.946728 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:59.947497 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:59.948099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:59.948980 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:59.949424 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:59.949846 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:00.208452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:00.209070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:00.219244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:00.222161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:00.222878 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:00.223827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:00.224517 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:00.225632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:00.537004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:00.551051 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-bf961f20-7f48-4f15-86c6-86ba65c0156b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021688 Sep 28 15:48:00.554205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:00.557567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:00.559109 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 220/451] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 15:47:59 2022] POST /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments => generated 194 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:00.575671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5c677ad6-69fb-47f4-8806-cb33b912c4d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.371065 Sep 28 15:48:00.579767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 232/452] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:00 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:01.606825 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:01.615188 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:01.632718 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=26 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:01.646352 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:01.647250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:01.648390 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:01.654013 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:01.654949 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:01.656753 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:01.717497 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:01.884701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:01.898598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:01.900387 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:01.901557 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-33d334da-3d11-4f57-9f8d-32d123622799 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.300101 Sep 28 15:48:01.902504 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 221/453] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:01 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:02.940855 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:02.941476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:02.972209 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:02.972996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:02.977324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:02.982290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:02.983025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:02.984696 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:03.243469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:03.293735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:03.298019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:03.304046 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-baf19b47-dffc-4a5a-b1db-85b020995fe2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.371940 Sep 28 15:48:03.305298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 233/454] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:02 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:04.340526 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:04.341473 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:04.364355 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:04.368661 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:04.369360 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:04.370365 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:04.372507 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:04.373797 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:04.609646 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:04.622131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:04.624000 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:04.625425 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-bae26cc4-f952-4e9e-9170-86bc0806e5f4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.292752 Sep 28 15:48:04.630112 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 222/455] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:04 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:05.655208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:05.657513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:05.660434 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=28 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:05.669469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:05.675241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:05.675923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:05.676957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:05.677574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:05.678182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:05.683504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:05.894177 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:05.907160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:05.910852 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:05.918286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7e1d5bf6-a6af-4ffa-86c5-7f2f38fd47bb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.267100 Sep 28 15:48:05.918894 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 234/456] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:05 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:06.949229 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:06.949959 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:06.957450 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:06.957925 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:06.958394 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:06.959133 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:06.959578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:06.960173 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:07.115959 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:07.125042 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:07.126626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:07.127801 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cacc890c-3ce2-4a2f-8bed-02b1620a2519 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1739 microversion: 2.20 time: 0.182467 Sep 28 15:48:07.130345 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 223/457] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:06 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:07.515138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-31e4bf32-045b-4d20-bc71-c8225f5e7d4d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Action: 'create', calling method: .version_select at 0x7f8fcfc86af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-363951845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/OSHRT5XKGWQDwoWR80CGZAb8rjh/X4nNvXEx7bObvN8d4EEcwSQpsZOXVaO/HJfNhR2HGfhYjo2fL7zaP2oQr+eAXGa72snFC1i+mQ2NNB3J2BPLiqnQJzRYZj2jLcQ=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:07.531275 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-31e4bf32-045b-4d20-bc71-c8225f5e7d4d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Getting quotas for project f3eec134d5864a3c82f27706eb8065fa. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:48:07.535040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-31e4bf32-045b-4d20-bc71-c8225f5e7d4d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Getting quotas for user 525cdc42a473486ba64b481cf2820d31 and project f3eec134d5864a3c82f27706eb8065fa. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:48:07.557698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-31e4bf32-045b-4d20-bc71-c8225f5e7d4d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047011 Sep 28 15:48:07.558296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 235/458] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 15:48:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:07.608037 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1411070767", "imageRef": "82f2db65-4bbd-436f-b8b9-c60b8cdf3a70", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-363951845", "networks": [{"uuid": "f2a968ad-f896-470e-bbb2-77c2a772a301"}]}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:07.664653 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] validate_networks() for [('f2a968ad-f896-470e-bbb2-77c2a772a301', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:48:08.121105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:48:08.121919 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:48:08.122121 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:48:08.122388 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:48:08.122922 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:48:08.133174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.133654 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.134082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.134852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.135299 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.135780 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.158457 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Getting quotas for project f3eec134d5864a3c82f27706eb8065fa. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:48:08.160218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:08.161047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:08.164213 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Getting quotas for user 525cdc42a473486ba64b481cf2820d31 and project f3eec134d5864a3c82f27706eb8065fa. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:48:08.173777 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.174479 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.178337 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:48:08.179052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.180252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.180439 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='82f2db65-4bbd-436f-b8b9-c60b8cdf3a70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:48:08.181440 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.182372 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.251255 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [3d624a7d-2d0f-450e-9b4e-3b54b38234f1] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 15:48:08.415338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:08.432197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:08.435288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:08.436749 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d8dab58c-ae05-4ca4-bbe6-2dbd9fc97429 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1721 microversion: 2.20 time: 0.282204 Sep 28 15:48:08.437306 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 236/459] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:08 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:08.577993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:08.580209 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:08.586716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.587533 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.588146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.588851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.589457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.590039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.614652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lazy-loading 'flavor' on Instance uuid 13bcecf7-6cc5-461e-a267-0c215dacf388 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:48:08.746889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e3361b52-e352-4319-9b5b-3163b0b276ae tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/action" status: 200 len: 32 microversion: 2.1 time: 0.173517 Sep 28 15:48:08.747498 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 237/460] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:48:08 2022] POST /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 15:48:08.759525 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:08.760321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:08.784602 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.785095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.785730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.786813 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.787290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.787873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:09.161418 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:09.169778 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9408ab2d-e45b-4e6f-9eb8-c66a5e9500c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.414522 Sep 28 15:48:09.170341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 238/461] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:08 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:09.260961 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [3d624a7d-2d0f-450e-9b4e-3b54b38234f1] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 39446. Sep 28 15:48:09.265411 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5e5c04cd-e922-4129-a696-1b368888f740 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660922 Sep 28 15:48:09.265794 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 224/462] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 15:48:09.276641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5ed51618-5577-4e03-8886-dfdf2154e837 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:09.277404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5ed51618-5577-4e03-8886-dfdf2154e837 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:09.331371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5ed51618-5577-4e03-8886-dfdf2154e837 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:09.338834 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5ed51618-5577-4e03-8886-dfdf2154e837 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1258 microversion: 2.1 time: 0.065916 Sep 28 15:48:09.339412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 239/463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:09 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:09.464393 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:09.465004 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:09.471723 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:09.472211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:09.472642 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:09.473335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:09.473783 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:09.474209 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:09.615324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:09.624689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:09.632883 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:09.634076 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-97e38eef-92ba-4463-be06-6d9800ece740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1721 microversion: 2.20 time: 0.173790 Sep 28 15:48:09.634660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 225/464] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:09 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:10.193399 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:10.194006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:10.203076 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.203560 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.203992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.204679 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.205161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.205584 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.340641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:10.350204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d192707b-9638-4ed4-9f63-0386a64f28f7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.160541 Sep 28 15:48:10.362629 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 240/465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:10 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:10.363783 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:10.364481 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:10.371608 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.372438 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.373042 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.373757 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.374198 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.374659 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.444432 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:10.452629 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4c8f24ed-5141-4aa1-9c04-bdc614b5992c tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1254 microversion: 2.1 time: 0.093185 Sep 28 15:48:10.453854 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 226/466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:10 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1254 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:10.575561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-98170f45-fb63-4c1c-a329-69c9b12de1f4 req-0f63fa7c-a476-4a99-b661-e7461368c0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b859de-bccb-472f-ab94-ede851f23b9a", "name": "network-vif-unplugged", "status": "completed", "tag": "e54cc8ad-2191-4813-9924-f40b092980cc"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:10.588461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-98170f45-fb63-4c1c-a329-69c9b12de1f4 req-0f63fa7c-a476-4a99-b661-e7461368c0a4 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.589207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-98170f45-fb63-4c1c-a329-69c9b12de1f4 req-0f63fa7c-a476-4a99-b661-e7461368c0a4 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.589727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-98170f45-fb63-4c1c-a329-69c9b12de1f4 req-0f63fa7c-a476-4a99-b661-e7461368c0a4 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.602768 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-98170f45-fb63-4c1c-a329-69c9b12de1f4 req-0f63fa7c-a476-4a99-b661-e7461368c0a4 service nova] Creating event network-vif-unplugged:e54cc8ad-2191-4813-9924-f40b092980cc for instance e1b859de-bccb-472f-ab94-ede851f23b9a on hv-cinder-85931 Sep 28 15:48:10.608836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-98170f45-fb63-4c1c-a329-69c9b12de1f4 req-0f63fa7c-a476-4a99-b661-e7461368c0a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037772 Sep 28 15:48:10.609830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 241/467] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:10.659713 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:10.660787 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:10.666699 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.667395 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.667996 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.668689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.669307 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.669871 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.818514 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:10.826879 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:10.828342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:10.829497 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a8b96847-0539-41dd-b87c-b90498516fcb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1724 microversion: 2.20 time: 0.174499 Sep 28 15:48:10.839518 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 227/468] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:10 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:10.855143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc064730-d94d-49f7-aec9-d9b67d1eccfb"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:10.857827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:10.864569 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.865127 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.865690 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.866470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:10.866993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:10.867482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.152266 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6d10d5d3-a156-417a-8c88-10178ba14590 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301661 Sep 28 15:48:11.153064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 242/469] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 28 15:48:10 2022] POST /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:48:11.283045 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:11.283734 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:11.289826 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.290302 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.290770 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.291451 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.291894 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.292314 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.335682 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126997) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 15:48:11.375607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:11.376324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:11.382975 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.383376 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.383864 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.384538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.385080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.385460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.407000 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dbd18360-e4b5-4779-a930-4d4bc91e16f5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/action" status: 202 len: 0 microversion: 2.20 time: 0.128377 Sep 28 15:48:11.407629 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 228/470] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 28 15:48:11 2022] POST /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:48:11.417095 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:11.418218 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:11.429753 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.430261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.431176 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.432145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.432797 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.433379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.631314 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:11.639551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a9b62dcd-f82c-40f3-8f6d-5a107819caaa tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.268407 Sep 28 15:48:11.648556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 243/471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:11 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:11.648556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:11.648556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:11.651478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.652132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.652752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.653622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.654220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.654847 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.664990 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:11.677759 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:11.691071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:11.698108 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1920fd0c-5a18-4452-8692-ab097b0caa2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.284200 Sep 28 15:48:11.699985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 229/472] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:11 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:11.739507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:11.749617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-870294e6-8fac-4b00-a02b-44b2bfcac977 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1328 microversion: 2.1 time: 0.107940 Sep 28 15:48:11.750581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 244/473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:11 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:12.671464 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:12.672914 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:12.682932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:12.684089 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:12.684933 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:12.685875 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:12.687170 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:12.687852 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:12.725908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:12.726543 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:12.742652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:12.743273 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:12.743765 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:12.744487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:12.744950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:12.747383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:12.947245 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:12.951457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:12.955470 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6542b714-462b-4c68-bbda-a38a51b15347 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.292109 Sep 28 15:48:12.956471 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 230/474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:12 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:12.963227 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:12.963441 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:12.963441 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:12.965898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:12.967156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0b55ee48-1ff5-4d02-95b6-465f5a53b740 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.246034 Sep 28 15:48:12.968106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 245/475] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:12 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:12.970629 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:12.971368 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:12.972092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:12.973044 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:12.973704 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:12.974480 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:13.118624 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:13.127482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-be2eb702-f640-41bc-9009-2c2c53d1561d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.169826 Sep 28 15:48:13.128068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 231/476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:12 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:13.979490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:13.980171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:13.987227 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:13.987718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:13.988151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:13.988857 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:13.989303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:13.989734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:13.999288 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:13.999911 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:14.007402 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:14.008193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:14.008699 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:14.009405 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:14.009849 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:14.010636 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:14.209070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:14.213874 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:14.223290 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:14.224907 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:14.226373 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a06fc221-4676-4cea-881f-e4b3cabf0414 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.231483 Sep 28 15:48:14.227230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4bd3339a-ee12-4178-bdc7-0ce9abe5f5dc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.251629 Sep 28 15:48:14.227850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 246/477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:13 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:14.235343 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:14.236117 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:14.242720 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 232/478] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:13 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:14.243664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:14.244149 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:14.244783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:14.245484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:14.245936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:14.246359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:14.391189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:14.399596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5d0a1bf4-6de9-478a-810e-744f79108813 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.167832 Sep 28 15:48:14.400169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 247/479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:14 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:15.253232 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:15.253877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:15.258077 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:15.258708 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:15.265290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:15.265737 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:15.266168 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:15.267070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:15.267518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:15.267699 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:15.267941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:15.268172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:15.268596 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:15.269280 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:15.269735 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:15.270133 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:15.476186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:15.480249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:15.482823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:15.486161 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e6f21eb4-1530-4007-a178-a5dcb3a39954 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.237366 Sep 28 15:48:15.486918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 233/480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:15 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:15.507017 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:15.507643 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:15.511992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:15.513575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:15.514805 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:15.514925 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b10ad8a7-fbe8-4975-98cb-6a49cbb2c3b3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.266210 Sep 28 15:48:15.515359 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:15.520438 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:15.521237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:15.521706 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:15.522345 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:15.527120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 248/481] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:15 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:15.666073 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:15.674582 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-78118093-e311-42ed-b024-3dd40952f928 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.179870 Sep 28 15:48:15.675950 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 234/482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:15 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:16.510530 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:16.511196 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:16.518169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:16.518678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:16.519104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:16.520121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:16.520253 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:16.520628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:16.544294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:16.544887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:16.552152 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:16.552755 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:16.553199 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:16.553897 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:16.554345 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:16.554793 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:16.722230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:16.732998 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9b28e91e-6ea1-4cc2-9ab5-e84f8f17d01f tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.226233 Sep 28 15:48:16.741725 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 249/483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:16 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:16.749145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:16.749145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:16.754518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:16.755011 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:16.755446 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:16.756146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:16.756596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:16.757021 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:16.793406 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:16.802163 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:16.807289 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:16.808716 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a66e7c9e-887d-496f-99b6-04ddc8d841c6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.268670 Sep 28 15:48:16.824374 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 235/484] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:16 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:16.899431 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:16.908572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8aa062cf-35fd-4298-8032-f705ab6386bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.165567 Sep 28 15:48:16.909443 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 250/485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:16 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:17.757431 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:17.758027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:17.765495 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:17.765979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:17.766593 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:17.767149 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:17.767604 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:17.768027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:17.835734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:17.837472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:17.846180 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:17.847262 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:17.848051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:17.849049 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:17.849721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:17.850358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:17.955635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:17.965484 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-39ada640-5904-4873-9cb3-f9a4e32404d6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.212052 Sep 28 15:48:17.966267 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 236/486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:17 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:17.970655 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:17.971258 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:17.982541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:17.983509 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:17.984245 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:17.985404 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:17.986316 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:17.987249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:18.005111 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:18.070320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:18.081959 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:18.083981 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:18.085530 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fd70638c-9689-4ce4-a60a-f9b50e3ffdc2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.255002 Sep 28 15:48:18.096784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 251/487] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:17 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:18.143888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:18.150757 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:18.158539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a2d34f5a-fe88-4037-a777-9b6f636b0518 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.191414 Sep 28 15:48:18.159200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 237/488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:17 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:18.991528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:18.992219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:18.999470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:18.999951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:19.000381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:19.001079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:19.001530 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:19.001951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:19.111103 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:19.111781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:19.114858 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=6 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:19.120109 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:19.120860 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:19.121720 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:19.122324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:19.122905 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:19.123358 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:19.150371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:19.160476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ee5f3609-2502-4485-9a59-2cd2fdb0c35d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.172188 Sep 28 15:48:19.175226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 252/489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:18 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:19.182482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:19.183107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:19.201176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:19.201722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:19.202150 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:19.202884 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:19.203323 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:19.203744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:19.335826 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=6 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:19.381328 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:19.388921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:19.390313 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:19.391999 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:19.393367 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-add43ff4-17cb-4779-987a-0d7998deb39c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.287233 Sep 28 15:48:19.394426 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 238/490] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:19 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:19.398347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9f8328d0-a069-4598-b0c8-319457e83a8f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.219888 Sep 28 15:48:19.405092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 253/491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:19 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:20.185082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:20.185885 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:20.195731 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.196515 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.197161 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.198248 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.198967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.199636 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.349174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:20.354235 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-46043f90-adce-4796-959c-48a0af6457dd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.173265 Sep 28 15:48:20.355210 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 239/492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:20 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:20.421479 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:20.422186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:20.422368 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:20.423015 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:20.429951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.430988 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.431272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.431983 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.432464 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.432901 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.435062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.435635 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.436033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.436741 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.437196 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.437723 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.668818 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:20.679929 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-9a3f906b-d93d-485a-907c-e873fc75c280 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.261423 Sep 28 15:48:20.681618 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 240/493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:20 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:20.698628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:20.708953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:20.710401 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:20.711594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3f37916e-1af2-4f4f-8c93-67667d05a762 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.295012 Sep 28 15:48:20.712158 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 254/494] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:20 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:21.378084 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:21.378697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:21.385130 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:21.385610 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:21.386039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:21.386752 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:21.387207 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:21.387626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:21.518999 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:21.527215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7a910d53-7c09-496c-9ba3-759191de71e7 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.153706 Sep 28 15:48:21.527785 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 241/495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:21 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:21.704832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:21.705433 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:21.712262 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:21.712745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:21.713177 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:21.713908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:21.714307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:21.714755 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:21.741463 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:21.742522 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:21.748556 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:21.749038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:21.749474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:21.750196 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:21.750678 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:21.751131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:21.894682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:21.902233 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-114be513-74b3-4a01-add9-f1f99fd363e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.201298 Sep 28 15:48:21.902843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 255/496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:21 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:21.922327 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:21.931039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:21.932496 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:21.933729 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dbc6492b-70ae-4aca-92f9-03ee3d907d69 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.196444 Sep 28 15:48:21.934231 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 242/497] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:21 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:22.550945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:22.551646 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:22.557796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.558269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.558728 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.559402 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.559838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.560249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.694940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:22.703123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cfd29bf6-a237-4189-ac3f-b7efd2ee9e46 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.156079 Sep 28 15:48:22.703684 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 256/498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:22 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:22.925651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:22.926256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:22.933007 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.933485 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.933916 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.934628 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.935079 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.935500 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.959663 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:22.960362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:22.967477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.967957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.968382 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.969071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.969519 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.969933 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:23.114978 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:23.122581 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-852831a0-74f4-4c8f-8a8b-60f495689475 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.200754 Sep 28 15:48:23.123341 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 243/499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:22 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:23.140657 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:23.149227 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:23.150730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:23.151882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-07cb2872-2d48-448c-ad82-d22da87db815 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1810 microversion: 2.20 time: 0.196140 Sep 28 15:48:23.152458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 257/500] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:22 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:23.726343 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:23.726966 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:23.732923 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:23.733394 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:23.733817 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:23.734511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:23.734953 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:23.735363 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:23.861141 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:23.869178 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ca208d60-f99d-4681-867c-8a5326a135f1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.146695 Sep 28 15:48:23.869740 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 244/501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:23 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:24.146652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:24.147259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:24.153701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.154183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.154665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.155359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.155804 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.156220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.177551 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:24.178180 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:24.186683 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.187173 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.187597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.188867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.188867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.189158 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.417261 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:24.422326 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:24.426952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-164c20f8-4760-4407-875c-9c60b2c755ea tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.285540 Sep 28 15:48:24.427827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 258/502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:24 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:24.431857 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:24.433449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:24.434636 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8e996fc8-0c44-46d9-aa5e-d7fc089319d2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1750 microversion: 2.20 time: 0.261502 Sep 28 15:48:24.435349 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 245/503] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:24 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1750 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:24.896613 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:24.897275 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:24.903488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.903967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.905457 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.906357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.906790 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.907492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.940558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-042072f6-1ddb-4bf4-b81f-008d5b3997af req-82bf528b-0915-40ea-920c-d53d73f0325f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2856eb9-043f-4d7d-972d-eef178a51b14", "tag": "fffc69bf-c846-46b6-872f-062d7c1cf28d"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:24.950113 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-042072f6-1ddb-4bf4-b81f-008d5b3997af req-82bf528b-0915-40ea-920c-d53d73f0325f service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.950809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-042072f6-1ddb-4bf4-b81f-008d5b3997af req-82bf528b-0915-40ea-920c-d53d73f0325f service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.951773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-042072f6-1ddb-4bf4-b81f-008d5b3997af req-82bf528b-0915-40ea-920c-d53d73f0325f service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.962796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-042072f6-1ddb-4bf4-b81f-008d5b3997af req-82bf528b-0915-40ea-920c-d53d73f0325f service nova] Creating event network-changed:fffc69bf-c846-46b6-872f-062d7c1cf28d for instance f2856eb9-043f-4d7d-972d-eef178a51b14 on hv-cinder-85931 Sep 28 15:48:24.968311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-042072f6-1ddb-4bf4-b81f-008d5b3997af req-82bf528b-0915-40ea-920c-d53d73f0325f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093092 Sep 28 15:48:24.969106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 259/504] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:48:25.036585 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:25.044915 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c9d1692e-71b2-4ea6-a737-b4e4ee94d420 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.153733 Sep 28 15:48:25.045479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 246/505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:24 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:25.452086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:25.453331 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:25.459605 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:25.460090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:25.460524 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:25.461200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:25.461743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:25.461743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:25.461929 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:25.462029 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:25.468797 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:25.469281 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:25.469709 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:25.470404 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:25.470880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:25.471299 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:25.656952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:25.660897 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:25.665153 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-72c483f1-494e-4a00-bbfe-a1f6d75793b8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.217736 Sep 28 15:48:25.665724 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 260/506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:25 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:25.669531 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:25.671523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:25.672683 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ca25b419-82ee-4045-879a-1459164930ed tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1752 microversion: 2.20 time: 0.215281 Sep 28 15:48:25.673227 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 247/507] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:25 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1752 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:26.068095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:26.068702 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:26.074822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:26.075302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:26.075732 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:26.076413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:26.076860 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:26.077281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:26.210771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:26.220925 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-df5f4b60-ed32-4d77-88f9-994b9168cae2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.156630 Sep 28 15:48:26.221519 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 261/508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:26 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:26.688745 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:26.689352 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:26.696418 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:26.697512 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:26.699285 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:26.700375 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:26.700830 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:26.701775 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:26.704543 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:26.705038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:26.721988 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:26.722568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:26.723070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:26.724276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:26.724492 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:26.724921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:26.904990 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:26.914555 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0c15929d-03c3-46a4-ac5a-8cac323f2871 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.229787 Sep 28 15:48:26.915139 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 248/509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:26 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:26.927193 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:26.937086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:26.938683 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:26.939911 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9c7f0109-aec7-46cf-ac55-e1b10ee99361 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1752 microversion: 2.20 time: 0.244797 Sep 28 15:48:26.940481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 262/510] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:26 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:27.244468 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:27.245067 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:27.252269 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:27.252269 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:27.252620 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:27.253305 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:27.253746 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:27.254164 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:27.382048 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:27.390203 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ec5272d1-9f85-4fb1-bcf0-06f3eeab7789 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1738 microversion: 2.1 time: 0.149553 Sep 28 15:48:27.390794 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 249/511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:27 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:27.944286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:27.944882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:27.951856 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:27.952251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:27.952670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:27.953371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:27.953807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:27.954215 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:27.966629 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:27.967741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:27.974067 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:27.974572 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:27.975001 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:27.975680 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:27.976129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:27.976561 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.153093 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:28.161474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8bbde5e1-341e-4eb3-9263-41cecab91448 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.220962 Sep 28 15:48:28.162053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 263/512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:27 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:28.165321 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:28.174071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:28.175474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:28.176613 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5f1b173c-115f-417b-8969-4980517b2786 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.214153 Sep 28 15:48:28.177156 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 250/513] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:27 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:28.413132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:28.413758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:28.419721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.420206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.420640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.421321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.421769 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.422189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.551517 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:28.560128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dfeefbe3-7b69-4c97-84ba-77e0ec7f5887 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1718 microversion: 2.1 time: 0.150934 Sep 28 15:48:28.561229 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 264/514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:28 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:28.622104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:28.622635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:28.629157 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.629636 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.630072 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.630805 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.631293 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.631744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.754646 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] HTTP exception thrown: Cannot 'detach_volume' instance 13bcecf7-6cc5-461e-a267-0c215dacf388 while it is in vm_state rescued Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Request method failure captured: Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: DELETE /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments/5abbdf1f-d1aa-400f-a0d1-abf8607b3fa4 HTTP/1.1 Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGt_2er79tVKTjBRL98AgLQ_NLvBE7zer4-8cNgwLpFCOZgaAF5fKYfvOXJAy-UYlFyUQWO-J5J291d2aXooMI-h8WPpmGYf2OrluKjAKOnvIj7hewQPtaL9EOgrGeWyogrmizVIEwdbDxX339uzpnhSAYrWbhy1Vt82fWp7H6Z54kw Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:48:28.756165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22d9fd2a9bec45938dd18540b1334a3b"}]}] Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: d8581d46699041d5a4dcb8a43034863e Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: > Sep 28 15:48:28.757821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Cannot 'detach_volume' instance 13bcecf7-6cc5-461e-a267-0c215dacf388 while it is in vm_state rescued Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'server_id': '13bcecf7-6cc5-461e-a267-0c215dacf388', 'id': '5abbdf1f-d1aa-400f-a0d1-abf8607b3fa4'} Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13bcecf7-6cc5-461e-a267-0c215dacf388 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:28.758701 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 13bcecf7-6cc5-461e-a267-0c215dacf388 while it is in vm_state rescued Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 13bcecf7-6cc5-461e-a267-0c215dacf388 while it is in vm_state rescued Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.760249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Returning 409 to user: Cannot 'detach_volume' instance 13bcecf7-6cc5-461e-a267-0c215dacf388 while it is in vm_state rescued {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:28.761569 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ffdf954b-593e-4e1f-9faa-0c01eba5353d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "DELETE /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments/5abbdf1f-d1aa-400f-a0d1-abf8607b3fa4" status: 409 len: 152 microversion: 2.1 time: 0.139626 Sep 28 15:48:28.761569 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 251/515] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 15:48:28 2022] DELETE /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments/5abbdf1f-d1aa-400f-a0d1-abf8607b3fa4 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 15:48:28.766426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:28.766865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:28.780417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.780896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.781318 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.782013 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.782472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.782884 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.821197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=100 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:28.848800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-82d2425d-9ed7-4d7a-9fcc-abdbb89703b8 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "POST /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/action" status: 202 len: 0 microversion: 2.1 time: 0.086106 Sep 28 15:48:28.849788 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 265/516] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:48:28 2022] POST /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:48:28.861378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:28.861813 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:28.873657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.874439 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.874994 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.875792 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.876249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.876707 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:29.127865 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:29.136601 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ca580c5d-1724-4904-b14d-9ca1beea3df2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.282492 Sep 28 15:48:29.137157 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 252/517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:28 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:29.185491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:29.186187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:29.192351 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:29.192830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:29.193332 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:29.193978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:29.194395 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:29.194849 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:29.201067 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:29.201672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:29.207804 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:29.208672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:29.209103 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:29.209788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:29.210234 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:29.210887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:29.383640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:29.391842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-df6cddaa-5a2d-43c4-aa2a-a174b2f2fb61 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.211399 Sep 28 15:48:29.392745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 266/518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:29 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:29.395143 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:29.404742 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:29.406199 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:29.407376 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-91006202-af8c-4d7e-9ec5-0d47d389e568 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.210301 Sep 28 15:48:29.407932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 253/519] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:29 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:30.159456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:30.160039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:30.166014 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.166515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.166940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.167608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.168048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.168457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.301942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:30.311047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5cd9e9f9-63e1-4c42-91fc-82e9886e3072 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.154803 Sep 28 15:48:30.311619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 267/520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:30 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:30.414955 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:30.415474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:30.422143 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.422715 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.423144 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.423821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.424266 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.424682 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.427343 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:30.432875 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:30.433477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:30.440036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.440515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.440942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.441630 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.442079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.442528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.618946 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:30.626679 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-85fcc6ba-856c-4ff4-b592-72b05f328a14 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.215561 Sep 28 15:48:30.627253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 254/521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:30 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:30.643169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:30.651931 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:30.653359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:30.655042 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3778a504-d94a-4a4b-b376-293a59add1ac tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.226657 Sep 28 15:48:30.655597 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 268/522] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:30 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:31.334061 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:31.334724 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:31.341017 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.341505 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.341932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.342658 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.343131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.343527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.650902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:31.651532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:31.657974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.658473 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.658927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.659612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.660047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.660463 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.870244 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:31.879544 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3e6c2848-785e-4a98-b324-307a7cd8f290 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.549264 Sep 28 15:48:31.880031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 255/523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:31 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:31.884682 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:31.885283 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:31.887325 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:31.893845 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.894904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.894904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.895450 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.895890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.896307 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:32.030116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:32.037796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7ff1fed0-4826-48e7-8619-d2bda05f7bc4 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.390623 Sep 28 15:48:32.038365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 269/524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:31 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:32.235043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:32.243618 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:32.245097 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:32.246251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-76766704-0600-48d5-bac3-eb2b8abcfbfb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.365251 Sep 28 15:48:32.247150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 256/525] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:31 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:32.904771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:32.905991 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:32.913379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:32.913867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:32.914537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:32.915440 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:32.915884 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:32.916488 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:33.061878 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:33.062684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:33.069571 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:33.070211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:33.070772 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:33.071748 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:33.072300 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:33.072817 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:33.079392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:33.091131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-508b045d-01e9-472f-8924-85d1a9f532c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.190320 Sep 28 15:48:33.092645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 270/526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:32 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:33.245334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:33.257887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-28cac75f-acf1-4057-b4c5-48ccc4764953 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.200307 Sep 28 15:48:33.271078 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 257/527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:33 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:33.276593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:33.277199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:33.283639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:33.285466 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:33.285928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:33.286659 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:33.287090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:33.287509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:33.448190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:33.459235 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:33.466228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:33.466228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-41797c36-4c7e-4a3a-8898-050ca8ea7cc7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.189539 Sep 28 15:48:33.475210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 271/528] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:33 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:34.118292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:34.120078 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:34.127136 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:34.127632 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:34.128075 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:34.128755 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:34.129193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:34.129604 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:34.280468 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:34.283063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:34.283771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:34.290229 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:34.290874 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:34.291384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:34.292090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:34.292462 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4edc1d05-eb5b-469c-b17a-9fc43595bde9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.180001 Sep 28 15:48:34.292573 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:34.292950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:34.293071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 258/529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:34 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:34.447663 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:34.456867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c72e2293-2a18-4969-b58e-ddbf0ff73f31 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.178723 Sep 28 15:48:34.457462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 272/530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:34 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:34.490456 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:34.491094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:34.500005 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:34.500700 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:34.501220 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:34.501956 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:34.502709 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:34.503183 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:34.656637 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:34.669207 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:34.671789 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:34.673251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d2f59991-701d-4a91-b072-0aa60c2203d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.187769 Sep 28 15:48:34.674174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 259/531] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:34 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:34.937477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-2c08fb5a-5541-4453-bad2-c5e99d1aabb5 req-ad652bee-edb3-4bc8-beba-505cd6b4aefb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2856eb9-043f-4d7d-972d-eef178a51b14", "name": "network-vif-plugged", "status": "completed", "tag": "fffc69bf-c846-46b6-872f-062d7c1cf28d"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:34.947744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2c08fb5a-5541-4453-bad2-c5e99d1aabb5 req-ad652bee-edb3-4bc8-beba-505cd6b4aefb service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:34.948304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2c08fb5a-5541-4453-bad2-c5e99d1aabb5 req-ad652bee-edb3-4bc8-beba-505cd6b4aefb service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:34.948630 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2c08fb5a-5541-4453-bad2-c5e99d1aabb5 req-ad652bee-edb3-4bc8-beba-505cd6b4aefb service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:34.961151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-2c08fb5a-5541-4453-bad2-c5e99d1aabb5 req-ad652bee-edb3-4bc8-beba-505cd6b4aefb service nova] Creating event network-vif-plugged:fffc69bf-c846-46b6-872f-062d7c1cf28d for instance f2856eb9-043f-4d7d-972d-eef178a51b14 on hv-cinder-85931 Sep 28 15:48:34.966744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-2c08fb5a-5541-4453-bad2-c5e99d1aabb5 req-ad652bee-edb3-4bc8-beba-505cd6b4aefb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Sep 28 15:48:34.967357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 273/532] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:35.318119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:35.318814 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:35.327247 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:35.328100 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:35.328925 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:35.329876 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:35.330572 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:35.331214 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:35.481796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:35.483264 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:35.490670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:35.491880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:35.492305 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:35.492794 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:35.493208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:35.493651 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:35.494067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:35.503165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b5bc804d-e342-4b27-82a0-e1d69b0c84c1 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.189177 Sep 28 15:48:35.503759 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 260/533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:35 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:35.648061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:35.656507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cb4d6061-be64-47cb-b2c8-0fa46adb3c00 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.179230 Sep 28 15:48:35.657062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 274/534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:35 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:35.699837 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:35.700443 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:35.706948 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:35.707426 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:35.707860 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:35.708545 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:35.708983 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:35.709398 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:35.848358 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:35.856941 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:35.858389 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:35.859566 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-31168ba0-ee98-4ece-864e-3d45fc105d79 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.163614 Sep 28 15:48:35.860122 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 261/535] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:35 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:36.537520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:36.538213 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:36.540850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:36.546336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:36.546994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:36.547831 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:36.548093 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:36.548505 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:36.548920 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:36.679528 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:36.680142 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:36.686911 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:36.687390 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:36.687841 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:36.688532 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:36.688964 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:36.689382 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:36.711578 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:36.721898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a783535c-9cae-4821-a0a2-b6075c215ccd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.188484 Sep 28 15:48:36.722705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 275/536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:36 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:36.829028 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:36.836930 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-be408e14-a65b-4440-b10a-f92dfd8bce19 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.161193 Sep 28 15:48:36.837507 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 262/537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:36 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:36.885794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:36.886404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:36.893073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:36.893559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:36.893994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:36.894729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:36.895179 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:36.895607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:37.034620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:37.043474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:37.045223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:37.046398 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-00051a46-f6c7-45c7-ad34-60427287284e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.164845 Sep 28 15:48:37.047596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 276/538] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:36 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:37.747027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:37.748281 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:37.755011 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:37.755482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:37.755910 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:37.756685 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:37.757127 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:37.757542 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:37.863190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:37.863805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:37.876113 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:37.884126 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:37.884565 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:37.885314 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:37.885763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:37.886184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:37.917385 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:37.926158 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-af7dda7a-f7c2-4795-baf2-774a4c378147 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.182957 Sep 28 15:48:37.926969 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 263/539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:37 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:38.036159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:38.046263 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9105f49a-4273-4bb9-a528-b6b023ce5a85 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.189492 Sep 28 15:48:38.046892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 277/540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:37 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:38.072273 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:38.072909 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:38.079409 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:38.079884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:38.080305 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:38.080993 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:38.081431 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:38.081844 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:38.220836 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:38.255801 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:38.257635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:38.258893 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-70d32977-6aaf-41e6-bc35-3a67e1f2b9ea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.190564 Sep 28 15:48:38.259980 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 264/541] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:38 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:38.949529 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:38.950246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:38.959079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:38.959569 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:38.960003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:38.960701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:38.961148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:38.961760 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:39.069006 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:39.069665 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:39.080918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:39.081408 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:39.081841 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:39.082586 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:39.083216 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:39.083807 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:39.134885 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:39.152259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b4cfa185-a0ad-46a1-9dc8-870e6c5a8f1a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.206521 Sep 28 15:48:39.163395 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 278/542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:38 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:39.227930 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:39.237037 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6bafbff8-23b8-48ff-8959-1a9e695d97e9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.171752 Sep 28 15:48:39.237604 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 265/543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:39 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:39.283403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:39.284031 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:39.290283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:39.290808 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:39.291240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:39.291950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:39.292400 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:39.292824 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:39.440515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:39.449671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:39.451348 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:39.452486 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cc6894e9-9589-4025-98e3-49587211eefb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.173157 Sep 28 15:48:39.453054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 279/544] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:39 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:40.182052 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:40.182776 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:40.189092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:40.189574 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:40.190004 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:40.190720 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:40.191167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:40.191585 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:40.261309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:40.262151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:40.269394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:40.270675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:40.270675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:40.271277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:40.271871 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:40.272307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:40.383250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:40.395910 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ab3cd7a6-afd4-47d6-8991-ff686dd82955 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.217962 Sep 28 15:48:40.396506 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 266/545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:40 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:40.459966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:40.468830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c935f316-8e40-430e-ad3e-6e8c23e9cb8d tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.211571 Sep 28 15:48:40.477811 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 280/546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:40 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:40.485264 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:40.486194 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:40.492739 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:40.493579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:40.494084 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:40.494915 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:40.495437 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:40.495930 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:40.644594 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:40.653264 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:40.655346 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:40.656488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-bffc5f46-776c-4474-ab75-f8685668db76 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.175957 Sep 28 15:48:40.657041 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 267/547] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:40 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:41.421786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:41.423329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:41.434006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:41.436059 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:41.436771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:41.437735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:41.438427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:41.439073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:41.497908 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:41.498535 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:41.505268 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:41.505747 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:41.506174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:41.506886 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:41.507335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:41.507756 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:41.631320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:41.640673 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e1e7dc61-06ef-4e59-81ac-26e901b6b3fc tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.223599 Sep 28 15:48:41.641251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 281/548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:41 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:41.678798 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:41.681779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:41.682488 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:41.688106 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c0e64850-9026-4130-96dc-660450f4c440 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.194895 Sep 28 15:48:41.688808 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 268/549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:41 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:41.689358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:41.689861 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:41.690274 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:41.691665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:41.692117 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:41.692541 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:41.708821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:41.860580 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:41.870817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:41.872672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:41.874098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fe73f83e-ca60-454d-88cc-8641634c4d36 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.196421 Sep 28 15:48:41.884251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 282/550] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:41 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:42.664816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:42.665423 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:42.672038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:42.672522 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:42.672956 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:42.673648 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:42.674096 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:42.674557 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:42.710753 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:42.711790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:42.719218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:42.720074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:42.720727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:42.722003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:42.722892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:42.723682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:42.865050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:42.874786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0cb215cf-a4fc-4386-9b32-15f5f3bd2b3b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.213857 Sep 28 15:48:42.875379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 269/551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:42 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:42.892837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:42.899501 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:42.900232 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:42.900705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d371500d-a914-48cf-bef2-adf7b38882d7 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.193732 Sep 28 15:48:42.901304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 283/552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:42 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:42.906319 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:42.906831 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:42.907254 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:42.907936 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:42.908374 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:42.908787 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:43.045321 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:43.047493 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:43.055735 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:43.057266 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:43.058400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1605dc75-16b1-4ae0-b8aa-230a28e5aaec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.162770 Sep 28 15:48:43.059006 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 270/553] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:42 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:43.898510 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:43.899112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:43.906319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:43.906849 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:43.907267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:43.907964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:43.908412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:43.908837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:43.984440 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:43.985230 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:43.992064 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:43.992550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:43.992984 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:43.993680 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:43.994124 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:43.994569 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:44.046726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:44.055089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6006e94d-9416-462d-bcd5-275de8e7569d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.160462 Sep 28 15:48:44.055923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 284/554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:43 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:44.083777 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:44.084377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:44.090246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:44.090824 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:44.091257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:44.091943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:44.092384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:44.092797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:44.142849 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:44.150465 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3cbc6c04-7649-4768-95c1-fdc9130966b5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.170454 Sep 28 15:48:44.150970 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 271/555] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:43 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:44.223722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:44.232240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:44.233670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:44.234845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-73f910bc-afd4-401c-9f60-bc6813ad5168 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.154873 Sep 28 15:48:44.235403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 285/556] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:44 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:45.079803 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:45.080364 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:45.086723 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:45.087200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:45.087631 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:45.088315 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:45.088762 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:45.089185 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:45.172679 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:45.173286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:45.179918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:45.180645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:45.181082 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:45.181753 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:45.182192 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:45.182633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:45.217617 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:45.225920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f058000d-52d5-4fe7-bc59-70e1320e3284 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.150527 Sep 28 15:48:45.226621 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 272/557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:45 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:45.261007 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:45.261642 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:45.268482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:45.268992 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:45.269424 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:45.270116 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:45.270603 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:45.271023 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:45.326565 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:45.334225 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-37ebd172-5327-4b2b-9e8d-c82e300d5519 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.165261 Sep 28 15:48:45.334777 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 286/558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:45 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:45.409557 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:45.418032 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:45.419501 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:45.420635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ba30b256-0143-42bc-8f60-a01357abd909 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.163630 Sep 28 15:48:45.421193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 273/559] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:45 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:46.249412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:46.250000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:46.256840 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:46.257319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:46.257751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:46.258503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:46.258957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:46.259383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:46.357801 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:46.358672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:46.365137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:46.365622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:46.366045 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:46.366761 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:46.367214 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:46.367632 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:46.389780 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:46.398139 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6ec771c6-52c4-4bda-bf5d-8acf9a1e867c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.152602 Sep 28 15:48:46.398779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 287/560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:46 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:46.445671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:46.446063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:46.451985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:46.452473 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:46.452907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:46.453914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:46.454367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:46.454819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:46.506598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:46.514158 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a4150657-b43f-4dcc-b7ea-64f184cfd092 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.160752 Sep 28 15:48:46.514747 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 274/561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:46 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:46.588376 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:46.597555 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:46.599047 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:46.600204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-49c910e4-4fc8-41a7-9e5e-680b679cd089 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.158936 Sep 28 15:48:46.600764 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 288/562] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:46 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:47.422826 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:47.423424 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:47.430021 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:47.430775 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:47.431204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:47.431886 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:47.432333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:47.432751 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:47.537126 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:47.537657 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:47.546103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:47.546628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:47.547129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:47.547786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:47.548434 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:47.548674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:47.568776 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:47.578967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a64d2cd9-14fd-4445-b225-5103711abbdd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1726 microversion: 2.1 time: 0.160372 Sep 28 15:48:47.579583 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 275/563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:47 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:47.626668 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:47.627277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:47.633677 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:47.634164 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:47.634633 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:47.635323 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:47.635771 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:47.636193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:47.690997 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:47.698661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2de3fea8-0a51-46ee-b336-d8cf8ccce0ab tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.165475 Sep 28 15:48:47.699225 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 289/564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:47 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:47.775912 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:47.785020 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:47.786470 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:47.787669 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-bda5b1b7-9faa-456c-8e90-1af6e24b3056 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.165538 Sep 28 15:48:47.788165 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 276/565] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:47 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:48.602225 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:48.602796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:48.609676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:48.610167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:48.610618 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:48.611311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:48.611757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:48.612363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:48.721053 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:48.721758 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:48.728524 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:48.729083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:48.729584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:48.730378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:48.730921 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:48.731417 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:48.823508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:48.832364 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f6c98c91-a0b3-437f-8b70-a966cf5c3354 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1732 microversion: 2.1 time: 0.234040 Sep 28 15:48:48.832950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 290/566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:48 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:48.837419 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:48.838023 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:48.843838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:48.844320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:48.844748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:48.845430 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:48.846494 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:48.846937 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:48.928105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:48.937011 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1559c8c7-819e-450b-a1a9-6bb72d8a8e16 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.219681 Sep 28 15:48:48.937589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 277/567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:48 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:48.942445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:48.942933 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:48.948760 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:48.949239 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:48.949667 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:48.950636 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:48.951031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:48.951451 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:49.001735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:49.010890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:49.012356 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:49.013566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0e41f9da-31c8-469f-a9f0-e17d9d1a7c67 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.179713 Sep 28 15:48:49.014118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 291/568] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:48 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:49.039995 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1f9595d6-8ec6-4267-8124-240078ea5d36 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101345 Sep 28 15:48:49.040597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 278/569] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 15:48:48 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:49.960110 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:49.960716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:49.968424 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:49.968909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:49.969340 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:49.970075 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:49.970550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:49.970974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:50.039554 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:50.040158 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:50.046111 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:50.046626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:50.047056 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:50.047745 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:50.048193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:50.048708 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:50.229928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:50.238081 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-469c7944-de60-441b-aa4e-e836f1d639e1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1358 microversion: 2.1 time: 0.281723 Sep 28 15:48:50.238844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 292/570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:49 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:50.298397 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:50.307566 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:50.309026 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:50.310745 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-eefb8853-776b-4990-9d77-fa6ee7e6b4a9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.275651 Sep 28 15:48:50.311309 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 279/571] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:50 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:50.463435 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-0ea0553d-a767-4475-b0df-ebd692ed7aeb req-f05b3646-61b6-4af1-a18a-b950dc75500b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bcecf7-6cc5-461e-a267-0c215dacf388", "tag": "649b2c71-9e63-43df-99c9-186b4043bdb6"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:50.472940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0ea0553d-a767-4475-b0df-ebd692ed7aeb req-f05b3646-61b6-4af1-a18a-b950dc75500b service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:50.473484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0ea0553d-a767-4475-b0df-ebd692ed7aeb req-f05b3646-61b6-4af1-a18a-b950dc75500b service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:50.473850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0ea0553d-a767-4475-b0df-ebd692ed7aeb req-f05b3646-61b6-4af1-a18a-b950dc75500b service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:50.488557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-0ea0553d-a767-4475-b0df-ebd692ed7aeb req-f05b3646-61b6-4af1-a18a-b950dc75500b service nova] Creating event network-changed:649b2c71-9e63-43df-99c9-186b4043bdb6 for instance 13bcecf7-6cc5-461e-a267-0c215dacf388 on hv-cinder-85931 Sep 28 15:48:50.493930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-0ea0553d-a767-4475-b0df-ebd692ed7aeb req-f05b3646-61b6-4af1-a18a-b950dc75500b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094066 Sep 28 15:48:50.494757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 293/572] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:51.263342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:51.263342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:51.270857 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.271344 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.271781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.272480 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.272932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.273559 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.337977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:51.338844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:51.345547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.346024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.346468 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.347158 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.347599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.348021 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.435261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:51.443391 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6a670d0c-2645-4137-a128-3788bd26eb6e tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1549 microversion: 2.1 time: 0.186096 Sep 28 15:48:51.443972 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 280/573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:51 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:51.467405 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:51.468017 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:51.473925 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.474419 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.474878 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.475568 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.476015 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.476439 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.499011 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:51.508038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:51.509783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:51.511011 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e53776df-fee6-419c-9622-7d705b54d83f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.177924 Sep 28 15:48:51.511594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 294/574] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:51 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:51.606622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:51.614484 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d0ef24c0-d7b3-4922-8973-329ded3ebad0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1549 microversion: 2.1 time: 0.151493 Sep 28 15:48:51.615002 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 281/575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:51 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:51.636239 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:51.641816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:51.642612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Searching by: {'deleted': False, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa'} {{(pid=126996) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 28 15:48:51.649159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.649631 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.650054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.650805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.651257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.651674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.740929 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.multi_cell_list [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126996) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 28 15:48:51.833310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8ed6d477-bc11-476e-befd-be6664d5b343 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200669 Sep 28 15:48:51.833812 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 295/576] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 28 15:48:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:51.845336 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:51.845932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:51.851809 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.852277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.852699 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.853365 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:51.853803 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:51.854214 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:51.981619 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:51.989712 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4bdb47cf-9e00-49e8-b510-4ab6905c27f0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1549 microversion: 2.1 time: 0.148179 Sep 28 15:48:51.990291 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 282/577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:51 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:48:52.509292 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-aa5d46b4-1be1-4367-9014-866911f665d3 req-e37e3624-9ad4-4c89-84fa-426224f13d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bcecf7-6cc5-461e-a267-0c215dacf388", "tag": "649b2c71-9e63-43df-99c9-186b4043bdb6"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:52.518618 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-aa5d46b4-1be1-4367-9014-866911f665d3 req-e37e3624-9ad4-4c89-84fa-426224f13d76 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:52.519087 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-aa5d46b4-1be1-4367-9014-866911f665d3 req-e37e3624-9ad4-4c89-84fa-426224f13d76 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:52.519543 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-aa5d46b4-1be1-4367-9014-866911f665d3 req-e37e3624-9ad4-4c89-84fa-426224f13d76 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:52.530511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-aa5d46b4-1be1-4367-9014-866911f665d3 req-e37e3624-9ad4-4c89-84fa-426224f13d76 service nova] Creating event network-changed:649b2c71-9e63-43df-99c9-186b4043bdb6 for instance 13bcecf7-6cc5-461e-a267-0c215dacf388 on hv-cinder-85931 Sep 28 15:48:52.536926 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-aa5d46b4-1be1-4367-9014-866911f665d3 req-e37e3624-9ad4-4c89-84fa-426224f13d76 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030873 Sep 28 15:48:52.537990 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 296/578] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:52.540839 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:52.541504 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:52.551347 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:52.551825 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:52.552763 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:52.553455 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:52.553898 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:52.554313 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:52.776489 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:52.786478 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:52.788192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:52.789372 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e6cbb5e5-a929-4ff9-97ce-244ecc24df3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.254399 Sep 28 15:48:52.792543 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 283/579] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:52 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:53.537660 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "005e4f20-80ba-49b7-ae08-2248da1a1589"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:53.540130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:53.546729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:53.547208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:53.547639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:53.548320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:53.548765 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:53.549186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:53.815447 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:53.816904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:53.823741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:53.824235 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:53.824661 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:53.825342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:53.825783 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:53.826193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:53.959837 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:53.968824 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:53.970263 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:53.971442 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-baddd391-06c6-4358-8971-b4e350133317 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.160522 Sep 28 15:48:53.971989 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 284/580] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:53 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:54.997916 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:54.998624 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:55.004969 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:55.005446 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:55.005887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:55.006599 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:55.007048 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:55.007469 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:55.138511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:55.147059 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:55.148488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:55.149619 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4d3b0226-0273-4787-a144-c687757db949 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.156301 Sep 28 15:48:55.150233 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 285/581] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:54 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:55.451952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f0acf6a4-15c5-40ba-983f-b5b4261f2804 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "POST /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.918897 Sep 28 15:48:55.452637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 297/582] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 15:48:53 2022] POST /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments => generated 194 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:56.176125 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:56.176772 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:56.184511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:56.185102 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:56.185538 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:56.186332 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:56.186847 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:56.187270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:56.318398 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:56.328297 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:56.334461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:56.334461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0b483d3d-21b8-4359-a8c2-15e8f081de8e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.160864 Sep 28 15:48:56.334461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 286/583] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:56 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:57.357917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:57.358627 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:57.364862 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:57.365345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:57.365776 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:57.366493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:57.366946 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:57.367365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:57.504320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:57.506686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:57.515479 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:57.516818 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:57.517983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-44d89b10-91af-4691-9daa-045688eb5390 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.164880 Sep 28 15:48:57.518577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 298/584] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:57 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:58.543087 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:58.544272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:58.550709 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:58.551178 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:58.551597 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:58.552268 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:58.552704 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:58.553114 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:58.684329 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:58.686538 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=100 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:58.694671 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:58.696107 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:58.697282 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cd3f8613-fd8c-4fc0-a14e-5f25dec80517 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.158137 Sep 28 15:48:58.697819 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 287/585] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:58 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:58.950190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-833afa9e-fc9f-4148-b0b6-4f108866a393 req-d50f98b2-50f6-48d5-9fde-15caaab6d004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b859de-bccb-472f-ab94-ede851f23b9a", "name": "network-vif-plugged", "status": "completed", "tag": "e54cc8ad-2191-4813-9924-f40b092980cc"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:58.959918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-833afa9e-fc9f-4148-b0b6-4f108866a393 req-d50f98b2-50f6-48d5-9fde-15caaab6d004 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:58.960394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-833afa9e-fc9f-4148-b0b6-4f108866a393 req-d50f98b2-50f6-48d5-9fde-15caaab6d004 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:58.960822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-833afa9e-fc9f-4148-b0b6-4f108866a393 req-d50f98b2-50f6-48d5-9fde-15caaab6d004 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:58.972766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-833afa9e-fc9f-4148-b0b6-4f108866a393 req-d50f98b2-50f6-48d5-9fde-15caaab6d004 service nova] Creating event network-vif-plugged:e54cc8ad-2191-4813-9924-f40b092980cc for instance e1b859de-bccb-472f-ab94-ede851f23b9a on hv-cinder-85931 Sep 28 15:48:58.977644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-833afa9e-fc9f-4148-b0b6-4f108866a393 req-d50f98b2-50f6-48d5-9fde-15caaab6d004 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090992 Sep 28 15:48:58.978247 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 299/586] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:59.722593 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:59.723205 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:59.729795 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:59.730300 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:59.731373 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:59.732096 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:59.732564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:59.732985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:59.862889 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:59.872200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:59.873653 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:59.874855 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-55ab7380-0d66-4e2c-bddd-8391f8a39337 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.156179 Sep 28 15:48:59.875420 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 288/587] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:59 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:49:00.901900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:00.903221 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:00.909309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:00.909788 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:00.910220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:00.910931 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:00.911376 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:00.911796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:01.038550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:01.047023 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:01.048450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:01.049587 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4e521813-de5f-4ce6-a556-c450c3e4f6ec tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.152548 Sep 28 15:49:01.050141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 300/588] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:49:00 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:49:02.074827 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:02.075428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:02.077579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=66 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:02.082836 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:02.083312 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:02.083739 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:02.084421 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:02.084863 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:02.085277 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:02.218831 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:02.227601 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:02.229169 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:02.230371 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c9a4922f-0dbf-4694-aad0-625f304b8b8f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1808 microversion: 2.20 time: 0.159446 Sep 28 15:49:02.231989 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 289/589] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:49:02 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:49:03.257594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:03.258821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:03.260865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:03.267071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:03.267559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:03.267990 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:03.268680 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:03.269125 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:03.269671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:03.401447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:03.410357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:03.411831 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:03.413156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-176e7a1e-81e6-4ddb-b1f7-7ff4d0e363e2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1795 microversion: 2.20 time: 0.159583 Sep 28 15:49:03.413786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 301/590] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:49:03 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:49:04.116621 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:04.117230 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:04.123854 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:04.124331 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:04.124761 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:04.125448 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:04.125895 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:04.126314 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:04.257474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:04.266632 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-2dcc77df-c344-4e89-b40d-a462520331be tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1595 microversion: 2.1 time: 0.153530 Sep 28 15:49:04.266900 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 290/591] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:04 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:06.135932 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-902ab61b-cf20-422c-9422-e94bac93f361 req-9f4d66c2-9cfb-44d5-b45f-beecec9b2005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2856eb9-043f-4d7d-972d-eef178a51b14", "tag": "fffc69bf-c846-46b6-872f-062d7c1cf28d"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:06.145898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-902ab61b-cf20-422c-9422-e94bac93f361 req-9f4d66c2-9cfb-44d5-b45f-beecec9b2005 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:06.146729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-902ab61b-cf20-422c-9422-e94bac93f361 req-9f4d66c2-9cfb-44d5-b45f-beecec9b2005 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:06.146976 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-902ab61b-cf20-422c-9422-e94bac93f361 req-9f4d66c2-9cfb-44d5-b45f-beecec9b2005 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:06.158853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-902ab61b-cf20-422c-9422-e94bac93f361 req-9f4d66c2-9cfb-44d5-b45f-beecec9b2005 service nova] Creating event network-changed:fffc69bf-c846-46b6-872f-062d7c1cf28d for instance f2856eb9-043f-4d7d-972d-eef178a51b14 on hv-cinder-85931 Sep 28 15:49:06.163950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-902ab61b-cf20-422c-9422-e94bac93f361 req-9f4d66c2-9cfb-44d5-b45f-beecec9b2005 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031611 Sep 28 15:49:06.164719 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 302/592] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:07.392116 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-434113498"}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:07.392654 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:07.399445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:07.399929 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:07.400359 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:07.401044 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:07.401488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:07.401906 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:07.538758 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.network.security_group_api [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Adding security group 6e2d7343-7dbd-4a1e-bae0-65a458597d71 to port fffc69bf-c846-46b6-872f-062d7c1cf28d Sep 28 15:49:07.859851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8f84408d-9bab-409e-bfa1-784e1ddec9d9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "POST /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/action" status: 202 len: 0 microversion: 2.1 time: 0.472277 Sep 28 15:49:07.860525 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 291/593] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:49:07 2022] POST /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:49:07.870642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:07.871339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:07.874237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=56 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:07.882298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:07.882808 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:07.883332 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:07.884171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:07.884622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:07.885041 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:08.035889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:08.044970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4a67d494-a7d8-4f48-a6cf-3dd4aef57ac5 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1759 microversion: 2.1 time: 0.179274 Sep 28 15:49:08.045557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 303/594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:07 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:08.178775 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-abacc512-b537-4239-a1e9-1fa05e48acca req-d039b6f5-62cf-44d2-9a31-5500fa00c46d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2856eb9-043f-4d7d-972d-eef178a51b14", "tag": "fffc69bf-c846-46b6-872f-062d7c1cf28d"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:08.188854 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-abacc512-b537-4239-a1e9-1fa05e48acca req-d039b6f5-62cf-44d2-9a31-5500fa00c46d service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:08.189327 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-abacc512-b537-4239-a1e9-1fa05e48acca req-d039b6f5-62cf-44d2-9a31-5500fa00c46d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:08.189941 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-abacc512-b537-4239-a1e9-1fa05e48acca req-d039b6f5-62cf-44d2-9a31-5500fa00c46d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:08.201018 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-abacc512-b537-4239-a1e9-1fa05e48acca req-d039b6f5-62cf-44d2-9a31-5500fa00c46d service nova] Creating event network-changed:fffc69bf-c846-46b6-872f-062d7c1cf28d for instance f2856eb9-043f-4d7d-972d-eef178a51b14 on hv-cinder-85931 Sep 28 15:49:08.206278 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-abacc512-b537-4239-a1e9-1fa05e48acca req-d039b6f5-62cf-44d2-9a31-5500fa00c46d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031061 Sep 28 15:49:08.207037 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 292/595] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:13.115829 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:13.116356 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:13.123014 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:13.123490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:13.123923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:13.124612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:13.125057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:13.125469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:13.148705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lazy-loading 'flavor' on Instance uuid 7cc8195d-c5bd-4e78-9001-13215dfedb9c {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:49:13.226677 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d29472a6-6d87-4400-800e-166c7c80ccf9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "POST /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c/action" status: 202 len: 0 microversion: 2.1 time: 0.115490 Sep 28 15:49:13.227263 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 304/596] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:49:13 2022] POST /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:49:13.235857 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:13.236558 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:13.246285 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:13.247766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:13.248374 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:13.249251 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:13.249908 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:13.250335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:13.404256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:13.411950 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-45883ee6-e19f-4d44-b3d1-aa392d14c86a tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.180242 Sep 28 15:49:13.412517 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 293/597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:13 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:14.437132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:14.437859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:14.444729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:14.445207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:14.445636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:14.446350 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:14.446848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:14.447283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:14.578755 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:14.586392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-deb8cdef-f94b-459e-8d70-40108f9fb5c4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.153461 Sep 28 15:49:14.586969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 305/598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:14 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:15.610690 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:15.611281 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:15.617644 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:15.618117 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:15.618567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:15.619246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:15.619690 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:15.620108 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:15.750994 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:15.758686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-45166ee8-264d-4066-a4c0-66c95f8efe15 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.152643 Sep 28 15:49:15.759243 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 294/599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:15 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:16.781953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:16.782574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:16.788964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:16.789762 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:16.789871 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:16.790576 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:16.791027 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:16.791448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:16.922774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:16.930736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-09f753fe-39c1-4f9c-93dd-625811f542d9 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.152681 Sep 28 15:49:16.931298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 306/600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:16 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:17.955091 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:17.955689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:17.962034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:17.962579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:17.962997 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:17.963665 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:17.964102 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:17.964518 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:18.093476 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:18.102818 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a0138d8b-0219-45ee-a77d-3e00e910dc2e tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.152491 Sep 28 15:49:18.103389 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 295/601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:17 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:19.126386 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:19.126950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:19.133471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:19.133952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:19.134389 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:19.135101 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:19.135551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:19.135979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:19.271974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:19.280204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-05322e24-e0b7-4056-aae7-18d98ab5d8ee tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.157757 Sep 28 15:49:19.280779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 307/602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:19 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:20.302818 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:20.303422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:20.310072 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:20.310660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:20.311092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:20.311778 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:20.312227 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:20.312670 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:20.450800 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:20.458622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3d0cfdeb-e04f-4e5c-af2f-4ce78bdafdd7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.159633 Sep 28 15:49:20.459192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 296/603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:20 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:21.485352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:21.486352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:21.492923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:21.493396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:21.493825 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:21.494539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:21.494989 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:21.495402 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:21.627143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:21.634838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a23e02d4-47f3-4e3f-b064-e1f613d5a61d tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.155996 Sep 28 15:49:21.635406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 308/604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:21 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:22.658871 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:22.659918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:22.667348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:22.667824 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:22.668257 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:22.669433 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:22.669968 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:22.670386 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:22.814567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:22.822201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1ef069ee-48b1-4562-be69-8eb987c49c2f tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.167728 Sep 28 15:49:22.822801 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 297/605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:22 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:23.846686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:23.847293 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:23.853825 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:23.854310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:23.854759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:23.855446 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:23.855914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:23.856308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:24.063015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:24.070875 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-23c87342-3d59-4058-a564-e6dc1bd14da2 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.228053 Sep 28 15:49:24.071456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 309/606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:23 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:25.095456 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:25.095996 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:25.102519 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:25.102987 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:25.103403 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:25.104068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:25.104505 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:25.104916 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:25.232844 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:25.240552 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-40df998d-91c4-472e-be2f-81b307d3107c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.149118 Sep 28 15:49:25.241113 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 298/607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:25 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:26.264375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:26.264883 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:26.271381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:26.271848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:26.272270 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:26.272945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:26.273384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:26.273818 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:26.424296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:26.437820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-40bff54e-f458-4dba-854d-918d3c4d3d59 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.177096 Sep 28 15:49:26.438441 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 310/608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:26 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:27.461093 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:27.461682 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:27.468981 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:27.469459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:27.469886 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:27.470615 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:27.471065 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:27.471488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:27.603366 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:27.611728 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-475980ac-3447-409f-a642-883f0bb89d07 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1511 microversion: 2.1 time: 0.154535 Sep 28 15:49:27.612306 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 299/609] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:27 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:27.634003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:27.634616 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:27.641042 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:27.641519 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:27.641948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:27.642666 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:27.643112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:27.643529 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:27.728317 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126996) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 15:49:27.791489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [99b39b10-0397-474a-a006-29c6fbb7d324] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 15:49:28.799247 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [99b39b10-0397-474a-a006-29c6fbb7d324] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40014. Sep 28 15:49:28.802380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ea24513a-88bd-45c1-a888-fd14bed5e4f8 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "POST /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c/action" status: 202 len: 0 microversion: 2.1 time: 1.172316 Sep 28 15:49:28.803217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 311/610] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:49:27 2022] POST /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c/action => generated 0 bytes in 1174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:49:28.811928 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:28.812538 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:28.819129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:28.819614 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:28.820032 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:28.820721 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:28.821170 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:28.821593 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:28.826040 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=68 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:28.960987 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:28.970271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-006f3774-9561-4355-a854-bb995d41b3d0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1519 microversion: 2.1 time: 0.162751 Sep 28 15:49:28.970915 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 300/611] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:28 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:29.067930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-8336a981-b5e2-49e7-a8ea-5c6170d6a20b req-53a547ad-7c52-4f22-9d5f-b4bc7f42ee8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc8195d-c5bd-4e78-9001-13215dfedb9c", "name": "network-vif-unplugged", "status": "completed", "tag": "6fe3578e-1526-411a-a9b7-3e91f28a36fb"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:29.079607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8336a981-b5e2-49e7-a8ea-5c6170d6a20b req-53a547ad-7c52-4f22-9d5f-b4bc7f42ee8c service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:29.080200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8336a981-b5e2-49e7-a8ea-5c6170d6a20b req-53a547ad-7c52-4f22-9d5f-b4bc7f42ee8c service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:29.080661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8336a981-b5e2-49e7-a8ea-5c6170d6a20b req-53a547ad-7c52-4f22-9d5f-b4bc7f42ee8c service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:29.085134 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:29.093389 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.compute.server_external_events [req-8336a981-b5e2-49e7-a8ea-5c6170d6a20b req-53a547ad-7c52-4f22-9d5f-b4bc7f42ee8c service nova] Unable to find a host for instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c. Dropping event network-vif-unplugged {{(pid=126996) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 28 15:49:29.094371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-8336a981-b5e2-49e7-a8ea-5c6170d6a20b req-53a547ad-7c52-4f22-9d5f-b4bc7f42ee8c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030856 Sep 28 15:49:29.095547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 312/612] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 28 15:49:29.993401 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:29.994004 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:30.000924 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:30.001401 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:30.001831 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:30.002543 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:30.002992 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:30.003409 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:30.135303 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:30.143804 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e5824852-8ac6-48c7-845c-611b05d1ec57 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1521 microversion: 2.1 time: 0.154294 Sep 28 15:49:30.144577 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 301/613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:29 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:31.167339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:31.167972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:31.176711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:31.177200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:31.177628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:31.178344 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:31.178821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:31.179241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:31.349181 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:31.357206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-78db6391-38d7-438f-a57f-009ba035c748 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.193789 Sep 28 15:49:31.357817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 313/614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:31 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:32.381309 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:32.381920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:32.384359 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=26 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:32.390257 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:32.390768 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:32.391199 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:32.391890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:32.392340 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:32.392762 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:32.525910 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:32.534219 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7cf2b708-a14f-4197-b3b7-b9a133abbc61 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.156917 Sep 28 15:49:32.534803 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 302/615] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:32 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:33.557475 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:33.557997 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:33.564523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:33.565001 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:33.565429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:33.566111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:33.566594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:33.567011 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:33.696508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:33.704197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6a70b07c-456c-4a82-a20d-d0340645cd21 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.150970 Sep 28 15:49:33.704761 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 314/616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:33 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:34.727901 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:34.728675 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:34.736088 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:34.736565 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:34.736995 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:34.737684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:34.738132 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:34.738584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:35.113115 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:35.120715 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-4abbef1e-3480-480b-8fd6-1d4890a96ff4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.396675 Sep 28 15:49:35.121273 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 303/617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:34 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:36.147026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:36.147654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:36.156571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:36.157048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:36.157477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:36.158169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:36.158640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:36.159058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:36.287539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:36.295673 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1fbbe4ee-833b-47ad-ad32-98a120674783 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.154445 Sep 28 15:49:36.296244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 315/618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:36 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:37.319815 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:37.320420 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:37.327428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:37.327902 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:37.328333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:37.329005 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:37.329448 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:37.329862 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:37.463104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:37.474079 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-33fae389-ab70-4623-b204-33e3b0131584 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.158167 Sep 28 15:49:37.474705 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 304/619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:37 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:38.499810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:38.500410 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:38.502784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:38.507910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:38.508382 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:38.508804 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:38.509475 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:38.509912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:38.510324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:38.642129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:38.651026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-638b2700-4122-474c-8439-cf868e70c12c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.154991 Sep 28 15:49:38.651609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 316/620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:38 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:39.674970 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:39.675567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:39.682139 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:39.682641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:39.683062 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:39.683728 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:39.684648 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:39.685058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:39.812647 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:39.820214 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8cd84693-a3f3-48f0-aab7-3109029f3419 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.149172 Sep 28 15:49:39.820781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 305/621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:39 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:40.843935 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:40.844572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:40.851070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:40.851539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:40.851969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:40.852655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:40.853102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:40.853511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:40.990511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:40.999185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3d620fa0-f843-4394-b1f0-43df01fbf0eb tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.159861 Sep 28 15:49:40.999752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 317/622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:40 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:42.024152 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:42.024684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:42.031151 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:42.031623 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:42.032042 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:42.032714 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:42.033151 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:42.033559 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:42.164109 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:42.172422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c26b179d-73fe-449b-963a-df735a6cb4cf tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.152186 Sep 28 15:49:42.172986 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 306/623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:42 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:43.196322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:43.196929 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:43.203179 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-450898a6-f5ac-4c26-ae84-8a66a7af66df req-818d9355-4fa6-4d6a-b9b9-23307bdae8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc8195d-c5bd-4e78-9001-13215dfedb9c", "name": "network-vif-plugged", "status": "completed", "tag": "6fe3578e-1526-411a-a9b7-3e91f28a36fb"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:43.203977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:43.204461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:43.205199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:43.205585 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:43.206032 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:43.206467 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:43.214110 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-450898a6-f5ac-4c26-ae84-8a66a7af66df req-818d9355-4fa6-4d6a-b9b9-23307bdae8f1 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:43.214679 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-450898a6-f5ac-4c26-ae84-8a66a7af66df req-818d9355-4fa6-4d6a-b9b9-23307bdae8f1 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:43.215237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-450898a6-f5ac-4c26-ae84-8a66a7af66df req-818d9355-4fa6-4d6a-b9b9-23307bdae8f1 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:43.228092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-450898a6-f5ac-4c26-ae84-8a66a7af66df req-818d9355-4fa6-4d6a-b9b9-23307bdae8f1 service nova] Creating event network-vif-plugged:6fe3578e-1526-411a-a9b7-3e91f28a36fb for instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c on hv-cinder-85931 Sep 28 15:49:43.233272 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-450898a6-f5ac-4c26-ae84-8a66a7af66df req-818d9355-4fa6-4d6a-b9b9-23307bdae8f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034374 Sep 28 15:49:43.234176 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 307/624] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:49:43.346971 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:43.354804 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-92dddffb-7b40-40b0-b1b6-a90e9a991474 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.162221 Sep 28 15:49:43.355311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 318/625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:43 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:44.378213 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:44.378939 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:44.385583 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:44.386057 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:44.386534 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:44.387206 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:44.387648 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:44.388077 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:44.522713 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:44.530513 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c62fb609-6f18-4305-bc63-fee4996df5e0 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1577 microversion: 2.1 time: 0.156489 Sep 28 15:49:44.531093 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 308/626] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:44 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:45.554604 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:45.555140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:45.561584 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:45.562058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:45.562516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:45.563197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:45.563642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:45.564057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:45.697603 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:45.705362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-478a072d-7ce8-4607-b8a6-44f6934038ed tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1564 microversion: 2.1 time: 0.154943 Sep 28 15:49:45.705938 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 319/627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:45 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:56.837217 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:56.837697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:56.840832 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=13 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:56.841489 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=49 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:56.847071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:56.847552 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:56.847985 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:56.848672 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:56.849120 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:56.849545 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:56.936036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lazy-loading 'services' on Instance uuid 13bcecf7-6cc5-461e-a267-0c215dacf388 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:49:57.054973 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-54bd788c-fc67-472d-a255-3f0aa12891b9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "DELETE /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments/5abbdf1f-d1aa-400f-a0d1-abf8607b3fa4" status: 202 len: 0 microversion: 2.1 time: 0.220961 Sep 28 15:49:57.055696 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 309/628] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 15:49:56 2022] DELETE /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments/5abbdf1f-d1aa-400f-a0d1-abf8607b3fa4 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:49:57.064255 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:57.066469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:57.068783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=7 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:57.069608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=43 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:57.075421 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:57.075915 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:57.076348 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:57.077051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:57.077503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:57.077952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:57.109277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c7f2c731-0b1a-4a0c-b896-556998d2f264 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049090 Sep 28 15:49:57.109856 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 320/629] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:49:57 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:58.123588 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:58.126104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:58.132855 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.133334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.133767 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.134522 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.134975 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.135395 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.167971 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-2df0ee9a-8eaf-4bd1-ade3-1f92e6701043 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049734 Sep 28 15:49:58.169058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 310/630] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:49:58 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:49:58.265324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:58.265818 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:58.272477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.272953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.273383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.274071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.274545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.274967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.301021 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:49:58.379246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8d252892-f92a-43f5-af67-a830bfbaf4c9 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "DELETE /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 204 len: 0 microversion: 2.1 time: 0.117602 Sep 28 15:49:58.379865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 321/631] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:49:58 2022] DELETE /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:49:58.388425 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:58.389032 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:58.395244 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.395728 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.396161 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.396847 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.397296 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.397718 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.533059 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:58.540781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a309610f-3280-42e2-be62-0c594446a62d tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1692 microversion: 2.1 time: 0.156303 Sep 28 15:49:58.541345 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 311/632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:58 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:59.565030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:59.565651 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:59.572083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:59.572562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:59.572986 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:59.573708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:59.574115 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:59.574642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:59.711203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:59.719360 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-139c0f79-b0ff-466c-8208-c2c0469839b3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1692 microversion: 2.1 time: 0.158608 Sep 28 15:49:59.719930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 322/633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:59 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:00.742934 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:00.743539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:00.750118 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:00.750633 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:00.751337 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:00.752134 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:00.752582 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:00.753301 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:00.887145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:00.895185 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-eae4ca7d-8576-49a6-8c0b-a6a5693c1e1c tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1692 microversion: 2.1 time: 0.156085 Sep 28 15:50:00.895756 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 312/634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:00 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:01.917996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:01.918615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:01.925067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:01.925535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:01.925954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:01.926671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:01.927109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:01.927520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:02.059250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:02.066990 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6a7cb65c-0f7a-438f-ba52-5af5a6b86555 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1692 microversion: 2.1 time: 0.152840 Sep 28 15:50:02.067599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 323/635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:01 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:02.194253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:02.194816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:02.201662 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:02.202191 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:02.202590 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:02.203291 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:02.203728 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:02.204142 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:02.228645 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Going to try to terminate instance {{(pid=126997) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:50:02.310526 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dca14c9c-57be-4b7c-81d1-b66a157513e1 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "DELETE /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 204 len: 0 microversion: 2.1 time: 0.119705 Sep 28 15:50:02.311211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 313/636] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:50:02 2022] DELETE /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:50:02.319482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:02.320086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:02.325961 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:02.326467 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:02.326904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:02.327588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:02.328032 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:02.328464 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:02.457980 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:02.465791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d078e492-658c-4c79-a162-657f3194edfc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1577 microversion: 2.1 time: 0.150191 Sep 28 15:50:02.466729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 324/637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:02 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:03.092112 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:03.092719 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:03.098698 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:03.099174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:03.099605 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:03.100279 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:03.100730 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:03.101146 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:03.233751 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:03.241513 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b6f67fc2-95c7-4933-9caa-6afcae0b47c2 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1692 microversion: 2.1 time: 0.154268 Sep 28 15:50:03.242077 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 314/638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:03 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:03.489018 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:03.489625 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:03.496580 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:03.497056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:03.497493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:03.498210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:03.498686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:03.499269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:03.634107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:03.642558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-da000a4a-7b7f-421c-aaf8-8c6fe91848ae tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1577 microversion: 2.1 time: 0.157351 Sep 28 15:50:03.643131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 325/639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:03 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:04.265174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:04.265786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:04.272497 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:04.272955 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:04.273385 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:04.274074 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:04.274550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:04.274976 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:04.551504 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:04.559452 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-fda93d22-c529-4674-bc48-f7ac406e9cfd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1692 microversion: 2.1 time: 0.298278 Sep 28 15:50:04.560072 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 315/640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:04 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1692 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:04.665335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:04.669203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:04.673253 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:04.673821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:04.674530 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:04.675342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:04.675890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:04.676389 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:05.015817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:05.024196 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c55d00ff-9c6d-4e12-b2ac-a6ac59420a49 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1577 microversion: 2.1 time: 0.362874 Sep 28 15:50:05.024778 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 326/641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:04 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1577 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:05.236127 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-ebc7bd7d-fa58-4d2b-826e-5a0e96589dad req-0605ddb8-bc77-4766-9f30-8e91f24b0e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bcecf7-6cc5-461e-a267-0c215dacf388", "name": "network-vif-deleted", "tag": "649b2c71-9e63-43df-99c9-186b4043bdb6"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:05.250333 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ebc7bd7d-fa58-4d2b-826e-5a0e96589dad req-0605ddb8-bc77-4766-9f30-8e91f24b0e33 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:05.250829 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ebc7bd7d-fa58-4d2b-826e-5a0e96589dad req-0605ddb8-bc77-4766-9f30-8e91f24b0e33 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:05.251248 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-ebc7bd7d-fa58-4d2b-826e-5a0e96589dad req-0605ddb8-bc77-4766-9f30-8e91f24b0e33 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:05.284884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-ebc7bd7d-fa58-4d2b-826e-5a0e96589dad req-0605ddb8-bc77-4766-9f30-8e91f24b0e33 service nova] Creating event network-vif-deleted:649b2c71-9e63-43df-99c9-186b4043bdb6 for instance 13bcecf7-6cc5-461e-a267-0c215dacf388 on hv-cinder-85931 Sep 28 15:50:05.294577 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-ebc7bd7d-fa58-4d2b-826e-5a0e96589dad req-0605ddb8-bc77-4766-9f30-8e91f24b0e33 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061774 Sep 28 15:50:05.295566 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 316/642] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:05.586363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:05.587976 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:05.594331 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:05.595523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:05.596054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:05.597115 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:05.598086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:05.599323 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:05.638092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:05.638867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:05.639420 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:05.640070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lazy-loading 'fault' on Instance uuid 13bcecf7-6cc5-461e-a267-0c215dacf388 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:50:05.968211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:05.986558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b3bdc651-51b9-4133-97c1-354a942409f6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 200 len: 1336 microversion: 2.1 time: 0.404423 Sep 28 15:50:05.987157 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 327/643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:05 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 1336 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:06.047999 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:06.048697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:06.057357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:06.058981 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:06.060583 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:06.061475 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:06.062199 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:06.062800 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:06.153579 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:06.162344 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ef4e761b-183a-45c4-9e38-3eceffd9b39b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 200 len: 1226 microversion: 2.1 time: 0.118462 Sep 28 15:50:06.163880 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 317/644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:06 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:07.014272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:07.016233 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 13bcecf7-6cc5-461e-a267-0c215dacf388] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:07.025765 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.027163 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.027848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.031842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.033029 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.033484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.049545 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] HTTP exception thrown: Instance 13bcecf7-6cc5-461e-a267-0c215dacf388 could not be found. Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Request method failure captured: Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 HTTP/1.1 Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGt_2er79tVKTjBRL98AgLQ_NLvBE7zer4-8cNgwLpFCOZgaAF5fKYfvOXJAy-UYlFyUQWO-J5J291d2aXooMI-h8WPpmGYf2OrluKjAKOnvIj7hewQPtaL9EOgrGeWyogrmizVIEwdbDxX339uzpnhSAYrWbhy1Vt82fWp7H6Z54kw Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:50:07.051223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22d9fd2a9bec45938dd18540b1334a3b"}]}] Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: d8581d46699041d5a4dcb8a43034863e Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 13bcecf7-6cc5-461e-a267-0c215dacf388 could not be found. Sep 28 15:50:07.053900 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '13bcecf7-6cc5-461e-a267-0c215dacf388'} Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13bcecf7-6cc5-461e-a267-0c215dacf388 could not be found. Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:50:07.055632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13bcecf7-6cc5-461e-a267-0c215dacf388 could not be found. Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13bcecf7-6cc5-461e-a267-0c215dacf388 could not be found. Sep 28 15:50:07.059065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.060251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Returning 404 to user: Instance 13bcecf7-6cc5-461e-a267-0c215dacf388 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:50:07.060251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1e7eebca-f7ff-4d4f-ab53-b91d1ac4b938 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388" status: 404 len: 111 microversion: 2.1 time: 0.045683 Sep 28 15:50:07.060251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 328/645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:07 2022] GET /compute/v2.1/servers/13bcecf7-6cc5-461e-a267-0c215dacf388 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:50:07.066552 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5527f076-60c1-49b3-bf60-9ca6e28e2a90 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '.version_select at 0x7f8fcbbfc0d0>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:07.103474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5527f076-60c1-49b3-bf60-9ca6e28e2a90 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583358113" status: 202 len: 0 microversion: 2.1 time: 0.043622 Sep 28 15:50:07.103935 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 318/646] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 28 15:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583358113 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:50:07.190404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:07.191062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:07.197297 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.197782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.198214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.198943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.199620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.200067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.215713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] HTTP exception thrown: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Request method failure captured: Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 HTTP/1.1 Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGw-HGf-N9WuZzhUZR3MYCgIqZIQYbhR_2uKFhO4JTLY6R8V8pNmvygKUeo8UumD-WutoEQADxKxMKB2hCk2YDSVKPguh4beV86EzSSLsujHIYYWWWt6tNWqekcf6iT7rVjwxDz81taytjO7GLkxCcorVGEmHBucE-33Y_URjVQfGyw Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: bcffff710dd74209b30a1d02fb2bec46 Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:50:07.217333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bcffff710dd74209b30a1d02fb2bec46"}]}] Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: bcffff710dd74209b30a1d02fb2bec46 Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-TestVolumeBootPattern-1295971202-project Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 88f34e4fc44e432d9e994ae5dcdbd1ae Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-TestVolumeBootPattern-1295971202-project Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:50:07.219413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '31a8645e-d57d-45ff-b0e3-686164f46a86'} Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:50:07.220217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:50:07.221536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:07.223113 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Returning 404 to user: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:50:07.223113 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1f2a208c-b143-47b3-a6d7-19f8302b17d4 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 404 len: 111 microversion: 2.1 time: 0.032455 Sep 28 15:50:07.223113 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 329/647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:07 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:50:07.331919 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1969834238", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1385565331", "security_groups": [{"name": "tempest-secgroup-smoke-714818131"}], "block_device_mapping_v2": [{"uuid": "ea401450-af6a-4323-9990-ee6b1c7456e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6eae24b-3c95-4cde-9586-a8891b23b1a7"}]}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:07.350313 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-f6d6adae-0a1b-4b1f-8130-9fdbae44cd28 req-caf0bc53-d17f-463f-b9d3-58201cc631d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a8645e-d57d-45ff-b0e3-686164f46a86", "name": "network-vif-deleted", "tag": "bc6cda45-9454-4e0f-b2fb-990cfe8f3cfa"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:07.365909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-f6d6adae-0a1b-4b1f-8130-9fdbae44cd28 req-caf0bc53-d17f-463f-b9d3-58201cc631d5 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.366701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-f6d6adae-0a1b-4b1f-8130-9fdbae44cd28 req-caf0bc53-d17f-463f-b9d3-58201cc631d5 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.367474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-f6d6adae-0a1b-4b1f-8130-9fdbae44cd28 req-caf0bc53-d17f-463f-b9d3-58201cc631d5 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.381381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-f6d6adae-0a1b-4b1f-8130-9fdbae44cd28 req-caf0bc53-d17f-463f-b9d3-58201cc631d5 service nova] Creating event network-vif-deleted:bc6cda45-9454-4e0f-b2fb-990cfe8f3cfa for instance 31a8645e-d57d-45ff-b0e3-686164f46a86 on hv-cinder-85931 Sep 28 15:50:07.387614 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-f6d6adae-0a1b-4b1f-8130-9fdbae44cd28 req-caf0bc53-d17f-463f-b9d3-58201cc631d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041937 Sep 28 15:50:07.388740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 330/648] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:07.518438 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] validate_networks() for [('b6eae24b-3c95-4cde-9586-a8891b23b1a7', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:50:08.143897 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:50:08.144447 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:50:08.144928 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:50:08.145325 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:50:08.145893 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:50:08.154727 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:08.155190 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:08.155609 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:08.156312 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:08.156745 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:08.157150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:08.173927 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Getting quotas for project bcffff710dd74209b30a1d02fb2bec46. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:50:08.177810 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Getting quotas for user 88f34e4fc44e432d9e994ae5dcdbd1ae and project bcffff710dd74209b30a1d02fb2bec46. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:50:08.235200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:50:08.237338 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea401450-af6a-4323-9990-ee6b1c7456e2',volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:50:08.366184 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7d020c56-cf51-4bf2-8c2d-3ae271097440 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.038144 Sep 28 15:50:08.367031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 319/649] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:50:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:50:08.380033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a8b19377-ddfa-4828-97c6-327305eb6a15 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:08.380726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a8b19377-ddfa-4828-97c6-327305eb6a15 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:08.453376 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a8b19377-ddfa-4828-97c6-327305eb6a15 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:08.460512 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a8b19377-ddfa-4828-97c6-327305eb6a15 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1095 microversion: 2.1 time: 0.085066 Sep 28 15:50:08.470896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 331/650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:08 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:09.485960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:09.486507 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:09.492488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.492965 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.493394 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.494157 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.494636 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.495058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.561910 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:09.570135 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cf82cfec-4e89-4343-bc26-54ae4aaac28c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1193 microversion: 2.1 time: 0.088555 Sep 28 15:50:09.570981 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 320/651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:09 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:10.339381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:10.339960 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:10.352638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.353137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.353566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.354278 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.354758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.355184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.390232 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:50:10.502042 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b741b972-ac9c-4b5e-94d0-d9786f165dbf tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "DELETE /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 204 len: 0 microversion: 2.1 time: 0.166586 Sep 28 15:50:10.502551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 332/652] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:50:10 2022] DELETE /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:50:10.511300 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:10.513092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:10.525335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.525835 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.526260 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.528847 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.529639 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.530395 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.597125 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:10.598003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:10.604681 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.605272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.605766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.606755 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.607209 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.607628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.854102 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:10.862994 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f1028938-db32-49a1-a526-83373df045fd tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1508 microversion: 2.1 time: 0.355762 Sep 28 15:50:10.863742 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 321/653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:10 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:10.908880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:10.917953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2f44d237-6741-4f2a-b8cc-ede758ff6b92 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1278 microversion: 2.1 time: 0.327461 Sep 28 15:50:10.918884 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 333/654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:10 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1278 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:10.975286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:10.975867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:10.982426 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.982916 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.983343 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.984036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.984483 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.984904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.018422 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e4a94be0-f45e-4d11-9aa2-a9caa0fae9ef tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments/fc064730-d94d-49f7-aec9-d9b67d1eccfb" status: 200 len: 194 microversion: 2.20 time: 0.153470 Sep 28 15:50:11.019026 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 322/655] 10.222.0.60 () {60 vars in 1454 bytes} [Wed Sep 28 15:50:10 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments/fc064730-d94d-49f7-aec9-d9b67d1eccfb => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:50:11.089048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:11.089542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:11.095512 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.096394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.097049 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.097759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.098204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.098654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.233555 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lazy-loading 'services' on Instance uuid e1b859de-bccb-472f-ab94-ede851f23b9a {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:50:11.303878 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-67cf86aa-f40b-4fab-a0aa-560b049dcb22 req-8ded0021-c4dc-4106-b8fd-5584d1b0ec83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7", "tag": "d7f2b0b9-c545-4a35-bbc8-398e8c021de4"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:11.314533 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-67cf86aa-f40b-4fab-a0aa-560b049dcb22 req-8ded0021-c4dc-4106-b8fd-5584d1b0ec83 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.315002 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-67cf86aa-f40b-4fab-a0aa-560b049dcb22 req-8ded0021-c4dc-4106-b8fd-5584d1b0ec83 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.315419 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-67cf86aa-f40b-4fab-a0aa-560b049dcb22 req-8ded0021-c4dc-4106-b8fd-5584d1b0ec83 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.328845 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-67cf86aa-f40b-4fab-a0aa-560b049dcb22 req-8ded0021-c4dc-4106-b8fd-5584d1b0ec83 service nova] Creating event network-changed:d7f2b0b9-c545-4a35-bbc8-398e8c021de4 for instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 on hv-cinder-85931 Sep 28 15:50:11.334176 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-67cf86aa-f40b-4fab-a0aa-560b049dcb22 req-8ded0021-c4dc-4106-b8fd-5584d1b0ec83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033793 Sep 28 15:50:11.334792 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 323/656] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:50:11.359672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8434becf-1f95-48de-bae1-d2af738c4506 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments/fc064730-d94d-49f7-aec9-d9b67d1eccfb" status: 202 len: 0 microversion: 2.20 time: 0.274364 Sep 28 15:50:11.360370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 334/657] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 28 15:50:11 2022] DELETE /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments/fc064730-d94d-49f7-aec9-d9b67d1eccfb => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:50:11.371560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:11.374611 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:11.380789 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.381258 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.381684 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.382363 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.382851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.383261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.414263 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a74bb001-c79c-42bc-87be-6124578158be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046944 Sep 28 15:50:11.417354 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 324/658] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 28 15:50:11 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:50:11.887871 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:11.888603 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:11.894772 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.895249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.895681 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.896402 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.896845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.897267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.901284 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:11.942071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:11.942680 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:11.949168 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.949654 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.950213 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.950935 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.951379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.951794 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.166509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:12.175438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d98d4469-3d8e-491e-b8ae-88998a18c595 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1508 microversion: 2.1 time: 0.291785 Sep 28 15:50:12.176294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 335/659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:11 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:12.255850 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:12.270306 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3bc3411a-2452-4b15-bd67-a57fcb69ab98 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.331923 Sep 28 15:50:12.270922 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 325/660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:11 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:12.428187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:12.432256 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:12.440108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.441337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.442056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.443006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.443592 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.444115 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.478658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2dcea253-355c-4f68-9cb8-669486e7f39b tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055002 Sep 28 15:50:12.479236 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 336/661] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 28 15:50:12 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:50:13.200276 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:13.200907 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:13.207553 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.208033 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.208460 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.209146 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.209598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.210009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.214565 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:13.245419 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.245902 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.246328 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.246858 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lazy-loading 'fault' on Instance uuid 37cbbb80-d096-4b55-bfd8-417ff2f04c26 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:50:13.289134 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:13.293075 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:13.294394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:13.299145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-233561c0-36d1-492c-bb2a-f4d9ef54baf6 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1312 microversion: 2.1 time: 0.102398 Sep 28 15:50:13.299884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 326/662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:13 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:13.300886 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.301370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.301796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.302497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.302982 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.303349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.352243 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-0292fb75-fc41-4a75-98e4-7b33285992c1 req-d5342bec-251d-495c-a358-2e1d712d4ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cbbb80-d096-4b55-bfd8-417ff2f04c26", "name": "network-vif-deleted", "tag": "cc793622-d700-461d-abc7-6af34373f544"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:13.362051 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-0292fb75-fc41-4a75-98e4-7b33285992c1 req-d5342bec-251d-495c-a358-2e1d712d4ee5 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.362556 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-0292fb75-fc41-4a75-98e4-7b33285992c1 req-d5342bec-251d-495c-a358-2e1d712d4ee5 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.362976 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-0292fb75-fc41-4a75-98e4-7b33285992c1 req-d5342bec-251d-495c-a358-2e1d712d4ee5 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.373645 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-0292fb75-fc41-4a75-98e4-7b33285992c1 req-d5342bec-251d-495c-a358-2e1d712d4ee5 service nova] Creating event network-vif-deleted:cc793622-d700-461d-abc7-6af34373f544 for instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 on hv-cinder-85931 Sep 28 15:50:13.378501 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-0292fb75-fc41-4a75-98e4-7b33285992c1 req-d5342bec-251d-495c-a358-2e1d712d4ee5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029904 Sep 28 15:50:13.379101 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 327/663] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:50:13.444497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:13.452246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0cc78cea-ac49-4479-94ac-7437cbd4d73d tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.163077 Sep 28 15:50:13.452813 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 337/664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:13 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:13.491328 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:13.493516 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:13.499705 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.500173 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.500593 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.501265 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.501708 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.502118 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.532406 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-251d61d5-4595-4cde-8337-957657e955ab tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045295 Sep 28 15:50:13.532953 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 328/665] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 28 15:50:13 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:13.596127 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:13.596619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:13.602652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.603124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.603553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.604236 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.604686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.605106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.630837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:50:13.706070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ec6ddae2-d2de-44e3-97e9-dd8408a96b4e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 204 len: 0 microversion: 2.20 time: 0.113660 Sep 28 15:50:13.706613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 338/666] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 28 15:50:13 2022] DELETE /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 15:50:13.714865 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:13.716074 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:13.721973 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.722472 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.722898 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.723567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.724009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.724421 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.851296 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:13.859334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:13.860809 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:13.861953 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-835825bf-3843-499e-9120-6fdd04a97232 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.150958 Sep 28 15:50:13.862529 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 329/667] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:13 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:50:14.322865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:14.323569 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:14.330330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.330944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.331398 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:14.332187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.332640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.333066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:14.364037 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.364497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.364923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:14.365354 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lazy-loading 'fault' on Instance uuid 37cbbb80-d096-4b55-bfd8-417ff2f04c26 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:50:14.405650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:14.413617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dddf0d66-3f7a-475d-8fb2-a7ab23810d9e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1312 microversion: 2.1 time: 0.094975 Sep 28 15:50:14.414181 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 339/668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:14 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:14.474675 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:14.475279 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:14.482626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.483099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.483526 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:14.484202 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.484645 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.485059 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:14.619398 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:14.627001 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0ad623b4-b563-4b14-b5ff-f35ba4037392 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.156309 Sep 28 15:50:14.627562 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 330/669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:14 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:14.888490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:14.889098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:14.895515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.896089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.896533 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:14.897210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.897658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.898076 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.024594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:15.033311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:15.034856 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:15.036008 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a07a44fc-4183-447e-b01f-10afd765bdfa tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.151577 Sep 28 15:50:15.036570 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 340/670] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:14 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:15.437200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:15.437829 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:15.443857 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.444325 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.444754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.445430 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.445867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.446280 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.477946 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.478637 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.478928 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.479367 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lazy-loading 'fault' on Instance uuid 37cbbb80-d096-4b55-bfd8-417ff2f04c26 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:50:15.539992 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:15.548181 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-87557a37-55a6-402d-8168-cdc76768248e tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 200 len: 1312 microversion: 2.1 time: 0.115194 Sep 28 15:50:15.548994 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 331/671] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:15 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:15.649008 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:15.649618 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:15.655822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.656312 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.656742 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.657427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.657874 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.658293 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.786853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:15.794533 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6bd01ae8-044e-4825-a8be-2046dbfa1ea6 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.149349 Sep 28 15:50:15.795095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 341/672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:15 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:16.061003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:16.061604 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:16.067539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.068031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.068491 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.069186 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.069660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.070121 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.316093 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:16.324271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:16.326276 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:16.327461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-479acc71-8fd1-4ad4-b657-5ca13f9773dc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1723 microversion: 2.20 time: 0.270241 Sep 28 15:50:16.328018 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 332/673] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:16 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:16.571700 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:16.572239 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 37cbbb80-d096-4b55-bfd8-417ff2f04c26] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:16.579112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.579599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.580033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.580735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.581181 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.581601 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.598153 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] HTTP exception thrown: Instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 could not be found. Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Request method failure captured: Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 HTTP/1.1 Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGt_2er79tVKTjBRL98AgLQ_NLvBE7zer4-8cNgwLpFCOZgaAF5fKYfvOXJAy-UYlFyUQWO-J5J291d2aXooMI-h8WPpmGYf2OrluKjAKOnvIj7hewQPtaL9EOgrGeWyogrmizVIEwdbDxX339uzpnhSAYrWbhy1Vt82fWp7H6Z54kw Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:50:16.599841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22d9fd2a9bec45938dd18540b1334a3b"}]}] Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: d8581d46699041d5a4dcb8a43034863e Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 could not be found. Sep 28 15:50:16.601345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '37cbbb80-d096-4b55-bfd8-417ff2f04c26'} Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 could not be found. Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:50:16.602132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 could not be found. Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 could not be found. Sep 28 15:50:16.603456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:50:16.604734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Returning 404 to user: Instance 37cbbb80-d096-4b55-bfd8-417ff2f04c26 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:50:16.604734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bd2a4ddd-7152-40e7-9385-a244f08627da tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26" status: 404 len: 111 microversion: 2.1 time: 0.033452 Sep 28 15:50:16.604734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 342/674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:16 2022] GET /compute/v2.1/servers/37cbbb80-d096-4b55-bfd8-417ff2f04c26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:50:16.610357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:16.611208 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:16.617347 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.617983 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.618261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.618991 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.619443 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.619867 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.645790 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Going to try to terminate instance {{(pid=126997) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:50:16.726264 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-91d96e2d-d810-4d2c-863c-694b3812390b tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 204 len: 0 microversion: 2.1 time: 0.119879 Sep 28 15:50:16.730143 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 333/675] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:50:16 2022] DELETE /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:50:16.736967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:16.737592 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:16.743393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.743876 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.744305 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.744991 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.745441 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.745859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.817820 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:16.818561 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:16.825120 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.825489 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.825922 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.826651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:16.827099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:16.827515 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:17.024659 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:17.033212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d8431c03-0283-4a6c-96c2-e8b8404381cb tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.301195 Sep 28 15:50:17.033785 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 343/676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:16 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:17.112441 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:17.120628 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cfd8703e-dd87-4f83-a197-05e7b11a42a8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.306981 Sep 28 15:50:17.121227 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 334/677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:16 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:17.353321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:17.354109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:17.360844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:17.361307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:17.361739 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:17.362448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:17.362898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:17.363311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:17.457077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:17.465815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:17.467303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:17.468461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-93a5ab03-87dc-4db0-bbd3-c362eebd55d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1656 microversion: 2.20 time: 0.119112 Sep 28 15:50:17.469306 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 344/678] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:17 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1656 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:17.582119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-daa6f82d-43a3-4854-b4d4-5bbd569dd61f req-0604b844-ebbe-4078-94d1-60536f8324f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b859de-bccb-472f-ab94-ede851f23b9a", "name": "network-vif-deleted", "tag": "e54cc8ad-2191-4813-9924-f40b092980cc"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:17.592159 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-daa6f82d-43a3-4854-b4d4-5bbd569dd61f req-0604b844-ebbe-4078-94d1-60536f8324f0 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:17.592834 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-daa6f82d-43a3-4854-b4d4-5bbd569dd61f req-0604b844-ebbe-4078-94d1-60536f8324f0 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:17.593039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-daa6f82d-43a3-4854-b4d4-5bbd569dd61f req-0604b844-ebbe-4078-94d1-60536f8324f0 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:17.604304 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-daa6f82d-43a3-4854-b4d4-5bbd569dd61f req-0604b844-ebbe-4078-94d1-60536f8324f0 service nova] Creating event network-vif-deleted:e54cc8ad-2191-4813-9924-f40b092980cc for instance e1b859de-bccb-472f-ab94-ede851f23b9a on hv-cinder-85931 Sep 28 15:50:17.609592 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-daa6f82d-43a3-4854-b4d4-5bbd569dd61f req-0604b844-ebbe-4078-94d1-60536f8324f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031387 Sep 28 15:50:17.610347 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 335/679] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:50:18.059608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:18.060141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:18.067974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.068438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.068887 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.069582 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.070022 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.070451 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.148813 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:18.149565 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:18.156996 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.157551 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.158055 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.158866 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.159531 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.169496 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.170294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:18.187955 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=6 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:18.215867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:18.224156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1cd0747b-2fe4-444f-b890-cf8a1919c6d3 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1522 microversion: 2.1 time: 0.170940 Sep 28 15:50:18.224966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 345/680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:18 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:18.322848 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:18.334954 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-44530e89-c69b-4f88-b29d-389804464e67 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.196383 Sep 28 15:50:18.335750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 336/681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:18 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:18.495289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:18.496738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:18.499129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:18.505429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.505880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.506603 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.507393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.507866 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.508285 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.541559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.542036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.542506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.542948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lazy-loading 'fault' on Instance uuid e1b859de-bccb-472f-ab94-ede851f23b9a {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:50:18.616155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:18.627623 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:18.629334 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:18.630531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-35911e1e-6f5e-41d4-819d-49b3833e5395 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 200 len: 1372 microversion: 2.20 time: 0.140550 Sep 28 15:50:18.631090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 346/682] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:18 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 1372 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:19.216034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:19.219050 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:19.225865 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.226371 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.226966 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.227982 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.228460 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.228903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.247175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:19.248054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:19.254438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.254919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.255352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.256048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.256495 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.256914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.324611 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-505213d3-08a7-404f-8ce7-d6a9b61d046f tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "POST /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/action" status: 202 len: 0 microversion: 2.1 time: 0.112890 Sep 28 15:50:19.325650 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 337/683] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:50:19 2022] POST /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:50:19.337835 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:19.338856 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:19.345854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8581d46699041d5a4dcb8a43034863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9fd2a9bec45938dd18540b1334a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:19.348214 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.349141 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.349807 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.350939 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.351668 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.352559 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.364710 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b9cc95c1-3d96-41f8-9716-f7d641b21e76 tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 200 len: 1480 microversion: 2.1 time: 0.113491 Sep 28 15:50:19.366948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 347/684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:19 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 1480 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:19.374501 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:19.376043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:19.386156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.387206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.387977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.388891 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.389397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.389852 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.644544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:19.650464 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:19.653400 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a58e6b28-bac6-4a0a-93f3-c9e3c27cfa9b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.284695 Sep 28 15:50:19.654655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 348/685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:19 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:19.658786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-466a8a00-60df-45f8-8d83-49d2bc6791d3 req-9a97ab84-46a7-4007-98a1-2e1445a19e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfd6533-e103-4f9d-905a-d839c4834f77", "name": "network-vif-deleted", "tag": "b1dc2b46-1b60-48c5-ab08-4ee2cbc934b7"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:19.660082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-18ced165-4c0c-4f5e-9226-c02531c35c05 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1751 microversion: 2.1 time: 0.329516 Sep 28 15:50:19.668229 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-466a8a00-60df-45f8-8d83-49d2bc6791d3 req-9a97ab84-46a7-4007-98a1-2e1445a19e7d service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.668700 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-466a8a00-60df-45f8-8d83-49d2bc6791d3 req-9a97ab84-46a7-4007-98a1-2e1445a19e7d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.669121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-466a8a00-60df-45f8-8d83-49d2bc6791d3 req-9a97ab84-46a7-4007-98a1-2e1445a19e7d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.673348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 338/686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:19 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1751 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:19.678216 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:19.679442 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:19.680268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-466a8a00-60df-45f8-8d83-49d2bc6791d3 req-9a97ab84-46a7-4007-98a1-2e1445a19e7d service nova] Creating event network-vif-deleted:b1dc2b46-1b60-48c5-ab08-4ee2cbc934b7 for instance 3cfd6533-e103-4f9d-905a-d839c4834f77 on hv-cinder-85931 Sep 28 15:50:19.685127 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-466a8a00-60df-45f8-8d83-49d2bc6791d3 req-9a97ab84-46a7-4007-98a1-2e1445a19e7d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030025 Sep 28 15:50:19.685707 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 349/687] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:19.686135 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.686650 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.687082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.687767 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.688236 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.688756 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.702960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] HTTP exception thrown: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Request method failure captured: Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a HTTP/1.1 Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGvdlJ7nByKUesvQpusQEtXz3LNqP2lkHDxJZz-TSenHyaY0SmSvrvP6vr26Hu2M4IQkPIYQGB9pwZ3vfnT3cEkcROtsg6hPjh367OblBvWFY9OnB8Yu1xa9ktjSB5VHNGa9HGpi1JZXBaXaTNSBaYIDS9QMarbmyYdIhlqS48rrmMA Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:50:19.704584 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c7541b0dd8b14bf495094ddaa132bc2a"}]}] Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 9ecdfa3c79f84cc29061dd5ebfa60101 Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: > Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:50:19.706145 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'id': 'e1b859de-bccb-472f-ab94-ede851f23b9a'} Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:50:19.707071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:50:19.708541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:19.709940 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Returning 404 to user: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:50:19.709940 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e5c423ee-b1b0-45d3-b742-9a1922f3bbea tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 404 len: 111 microversion: 2.20 time: 0.031528 Sep 28 15:50:19.709940 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 339/688] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:19 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:50:19.716118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bd47ad6f-654e-4117-be23-680518deab47 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '.version_select at 0x7f8fcf9ea040>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:19.735680 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bd47ad6f-654e-4117-be23-680518deab47 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682306247" status: 204 len: 0 microversion: 2.20 time: 0.024158 Sep 28 15:50:19.736179 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 350/689] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 28 15:50:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682306247 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 28 15:50:20.397716 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:20.398345 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] [instance: 3cfd6533-e103-4f9d-905a-d839c4834f77] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:20.408863 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.409357 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.415105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:20.415105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.415105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.415105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:20.427182 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] HTTP exception thrown: Instance 3cfd6533-e103-4f9d-905a-d839c4834f77 could not be found. Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Request method failure captured: Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 HTTP/1.1 Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGt_2er79tVKTjBRL98AgLQ_NLvBE7zer4-8cNgwLpFCOZgaAF5fKYfvOXJAy-UYlFyUQWO-J5J291d2aXooMI-h8WPpmGYf2OrluKjAKOnvIj7hewQPtaL9EOgrGeWyogrmizVIEwdbDxX339uzpnhSAYrWbhy1Vt82fWp7H6Z54kw Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:50:20.429014 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9fd2a9bec45938dd18540b1334a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22d9fd2a9bec45938dd18540b1334a3b"}]}] Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 22d9fd2a9bec45938dd18540b1334a3b Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482594954 Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: d8581d46699041d5a4dcb8a43034863e Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482594954-project Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: > Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Instance 3cfd6533-e103-4f9d-905a-d839c4834f77 could not be found. Sep 28 15:50:20.431539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'id': '3cfd6533-e103-4f9d-905a-d839c4834f77'} Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cfd6533-e103-4f9d-905a-d839c4834f77 could not be found. Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:50:20.432292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cfd6533-e103-4f9d-905a-d839c4834f77 could not be found. Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cfd6533-e103-4f9d-905a-d839c4834f77 could not be found. Sep 28 15:50:20.433492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:50:20.435311 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] Returning 404 to user: Instance 3cfd6533-e103-4f9d-905a-d839c4834f77 could not be found. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:50:20.435311 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1b3d59c4-c327-4326-a49b-1e5d3eec390a tempest-ServerRescueNegativeTestJSON-482594954 tempest-ServerRescueNegativeTestJSON-482594954-project] 10.222.0.60 "GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77" status: 404 len: 111 microversion: 2.1 time: 0.044456 Sep 28 15:50:20.435311 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 340/690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:20 2022] GET /compute/v2.1/servers/3cfd6533-e103-4f9d-905a-d839c4834f77 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:50:20.439524 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f7667aa9-034b-4441-8f72-3e83710c154e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'create', calling method: .version_select at 0x7f8fcfa9f0d0>, body: {"keypair": {"name": "tempest-keypair-39493001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU35L/TuGZu4Zkvn9WmGfd96Z+pfXmZUt26xfhHus4r9nZcOoV65T93Q4nrOnnJPpS+yPdjrj6vkXeXoz2MgQCrM4P3Nruy2tWwviEimKn8iFIPi9OLTJaIlsL3Z+npHQ=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:20.456672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-f7667aa9-034b-4441-8f72-3e83710c154e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Getting quotas for project c7541b0dd8b14bf495094ddaa132bc2a. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:50:20.460794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-f7667aa9-034b-4441-8f72-3e83710c154e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Getting quotas for user 9ecdfa3c79f84cc29061dd5ebfa60101 and project c7541b0dd8b14bf495094ddaa132bc2a. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:50:20.470092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:20.484328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f7667aa9-034b-4441-8f72-3e83710c154e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.048636 Sep 28 15:50:20.484951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 351/691] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 28 15:50:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 15:50:20.676715 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:20.679114 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:20.682587 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:20.685059 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:20.686085 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:20.686225 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.686708 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.687368 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:20.688263 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.688888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.689620 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:20.695549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.696030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.696455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:20.697150 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.697589 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.698189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:20.895505 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:20.904905 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1ee88537-c884-47d1-aad8-b54723f40447 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.232195 Sep 28 15:50:20.905744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 341/692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:20 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:20.940606 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:20.943951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:20.950494 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c039ef38-233e-43e1-b966-6177485d7bdc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.270699 Sep 28 15:50:20.951068 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 352/693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:20 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:21.928030 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:21.929099 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:21.936070 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:21.936776 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:21.937202 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:21.937888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:21.938505 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:21.939138 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:21.943604 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:21.977958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:21.978532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:21.987246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:21.987738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:21.988170 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:21.989067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:21.989676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:21.990252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:22.252549 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:22.271403 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e5cdb623-c2da-4fff-a95d-500dff2b608f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.347142 Sep 28 15:50:22.272119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 342/694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:21 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:22.301121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:22.311650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-eb006cae-ba1b-46bf-9e25-727eb62b83b9 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.341717 Sep 28 15:50:22.312359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 353/695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:21 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:22.319645 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-736140644", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a084e51-a246-4b59-8959-18fe57f781ea"}], "security_groups": [{"name": "tempest-securitygroup--245583083"}], "key_name": "tempest-keypair-39493001", "user_data": "}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:22.425887 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] validate_networks() for [('1a084e51-a246-4b59-8959-18fe57f781ea', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:50:22.852754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:50:22.853288 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:50:22.853920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:50:22.854589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:50:22.855168 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:50:22.873334 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:22.874148 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:22.874948 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:22.875893 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:22.878766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:22.879474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:22.899774 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Getting quotas for project c7541b0dd8b14bf495094ddaa132bc2a. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:50:22.904776 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Getting quotas for user 9ecdfa3c79f84cc29061dd5ebfa60101 and project c7541b0dd8b14bf495094ddaa132bc2a. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:50:22.917718 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:50:22.920501 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:50:22.988960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1062dbed-ea7d-41e0-bf72-40aff7e48652 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.674005 Sep 28 15:50:22.994814 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 343/696] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 28 15:50:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 15:50:23.001724 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fce460aa-c0f4-4504-ae1b-320e9094a974 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:23.002328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fce460aa-c0f4-4504-ae1b-320e9094a974 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:23.062146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fce460aa-c0f4-4504-ae1b-320e9094a974 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:23.072199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fce460aa-c0f4-4504-ae1b-320e9094a974 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:23.073836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fce460aa-c0f4-4504-ae1b-320e9094a974 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:23.075799 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fce460aa-c0f4-4504-ae1b-320e9094a974 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1279 microversion: 2.20 time: 0.078278 Sep 28 15:50:23.093032 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 354/697] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:22 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:23.296915 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:23.297542 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:23.306343 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:23.306857 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:23.307498 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:23.308192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:23.309273 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:23.309698 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:23.335477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:23.336080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:23.350321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:23.350757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:23.351215 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:23.352080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:23.353281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:23.353281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:23.559772 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:23.591269 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b4e01977-eefb-4c59-b0f0-ed02fd6d0422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.299700 Sep 28 15:50:23.602869 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 344/698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:23 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:23.654585 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:23.664429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8559805c-2cac-4d9e-8263-b2d5ecb747a0 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.332662 Sep 28 15:50:23.682452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 355/699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:23 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:24.100338 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:24.101981 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:24.110968 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:24.111487 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:24.111917 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:24.112643 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:24.113903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:24.114551 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:24.224595 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:24.244515 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:24.254808 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:24.258833 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c1933aeb-9bc0-4b0c-aec8-19fdb5884b3f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1331 microversion: 2.20 time: 0.161763 Sep 28 15:50:24.265194 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 345/700] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:24 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:24.621636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:24.622171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:24.637128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:24.637128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:24.637128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:24.637582 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:24.637939 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:24.638373 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:24.689255 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:24.689933 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:24.696248 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:24.696735 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:24.697169 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:24.697864 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:24.698314 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:24.698766 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:25.088302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:25.096147 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:25.097730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cefe533c-252c-4fe4-81bb-a3805225c27e tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.480058 Sep 28 15:50:25.098405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 356/701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:24 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:25.109060 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-07b34efb-3d0a-4ed8-936c-551799527165 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.423626 Sep 28 15:50:25.117263 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 346/702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:24 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:25.297265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:25.298104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:25.305645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:25.306559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:25.307236 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:25.308226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:25.309115 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:25.309772 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:25.407166 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:25.421508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:25.424458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:25.427421 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a3f8a098-8dd5-411c-86b8-ff5d4dcf7074 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1337 microversion: 2.20 time: 0.137895 Sep 28 15:50:25.428674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 357/703] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:25 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1337 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:25.603214 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-13978a57-1f80-4a37-aa18-23dd80d0f50e req-5b813089-5448-4750-b15d-b2f4e72a1660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7", "name": "network-vif-plugged", "status": "completed", "tag": "d7f2b0b9-c545-4a35-bbc8-398e8c021de4"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:25.616107 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-13978a57-1f80-4a37-aa18-23dd80d0f50e req-5b813089-5448-4750-b15d-b2f4e72a1660 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:25.616680 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-13978a57-1f80-4a37-aa18-23dd80d0f50e req-5b813089-5448-4750-b15d-b2f4e72a1660 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:25.617504 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-13978a57-1f80-4a37-aa18-23dd80d0f50e req-5b813089-5448-4750-b15d-b2f4e72a1660 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:25.635991 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-13978a57-1f80-4a37-aa18-23dd80d0f50e req-5b813089-5448-4750-b15d-b2f4e72a1660 service nova] Creating event network-vif-plugged:d7f2b0b9-c545-4a35-bbc8-398e8c021de4 for instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 on hv-cinder-85931 Sep 28 15:50:25.642008 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-13978a57-1f80-4a37-aa18-23dd80d0f50e req-5b813089-5448-4750-b15d-b2f4e72a1660 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042501 Sep 28 15:50:25.644836 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 347/704] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:50:26.120879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:26.122061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:26.128960 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:26.129448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:26.129881 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:26.130613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:26.131234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:26.131813 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:26.133239 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:26.133943 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:26.140448 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:26.140935 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:26.141542 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:26.142400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:26.143119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:26.143696 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:26.456358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:26.464455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-87a6cb5a-5b39-4ed5-bde2-e169fac0a912 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.347364 Sep 28 15:50:26.465557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 358/705] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:26 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:26.468567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:26.470939 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:26.471732 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:26.478934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:26.479243 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-cb4911d3-7c68-481f-a5a3-a6a52cbc4e80 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.350402 Sep 28 15:50:26.479885 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:26.480974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:26.481537 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 348/706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:26 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:26.482015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:26.482491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:26.482910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:26.730831 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:26.740602 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:26.742143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:26.743172 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4af97113-47ac-4d4c-a964-f99f049448fd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1404 microversion: 2.20 time: 0.276838 Sep 28 15:50:26.744050 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 359/707] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:26 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1404 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:26.923443 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-2c8fd18d-8674-44e1-a3c6-8429ee172df1 req-2dcb7b23-0434-4e63-82f7-505c2c85dac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739d6d0d-957f-4915-a855-0e3243c78b03", "tag": "5618ab50-2cf5-4a89-9eff-d989039147e5"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:26.934862 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-2c8fd18d-8674-44e1-a3c6-8429ee172df1 req-2dcb7b23-0434-4e63-82f7-505c2c85dac6 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:26.935343 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-2c8fd18d-8674-44e1-a3c6-8429ee172df1 req-2dcb7b23-0434-4e63-82f7-505c2c85dac6 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:26.935767 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-2c8fd18d-8674-44e1-a3c6-8429ee172df1 req-2dcb7b23-0434-4e63-82f7-505c2c85dac6 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:26.951327 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-2c8fd18d-8674-44e1-a3c6-8429ee172df1 req-2dcb7b23-0434-4e63-82f7-505c2c85dac6 service nova] Creating event network-changed:5618ab50-2cf5-4a89-9eff-d989039147e5 for instance 739d6d0d-957f-4915-a855-0e3243c78b03 on hv-cinder-85931 Sep 28 15:50:26.962009 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-2c8fd18d-8674-44e1-a3c6-8429ee172df1 req-2dcb7b23-0434-4e63-82f7-505c2c85dac6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043907 Sep 28 15:50:26.963107 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 349/708] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:27.489776 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:27.490381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:27.502077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:27.502617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:27.503105 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:27.503820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:27.506659 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:27.508932 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:27.509129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:27.509464 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:27.524061 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:27.525351 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:27.525866 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:27.526833 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:27.528003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:27.528588 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:27.719449 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:27.729062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ebb46b0d-2221-41bc-8eb8-51457d5d1246 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1266 microversion: 2.1 time: 0.243540 Sep 28 15:50:27.749329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 360/709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:27 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:27.756183 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:27.771300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:27.771909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:27.772690 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-30baf4e5-1909-4171-8e1a-d7254a5df411 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.272259 Sep 28 15:50:27.773278 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 350/710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:27 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:27.785533 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:27.786124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:27.786919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:27.787837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:27.788426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:27.788970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:28.005067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:28.016027 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:28.017904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:28.019220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a712491d-8a71-4f77-a52a-43534290d064 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1404 microversion: 2.20 time: 0.251714 Sep 28 15:50:28.019866 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 361/711] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:27 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:28.756750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:28.757365 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:28.765552 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:28.765965 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:28.766400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:28.767117 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:28.767566 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:28.767982 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:28.797620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:28.800288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:28.807568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:28.808022 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:28.808457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:28.809158 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:28.809597 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:28.810366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:28.992810 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:29.013575 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0b3254e3-0550-49af-8d5d-14966e72cd94 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1453 microversion: 2.1 time: 0.260136 Sep 28 15:50:29.014661 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 351/712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:28 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:29.026308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:29.036934 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:29.037273 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-faf42f04-9ac8-4b0f-b8bb-5596f609c4bb tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.244209 Sep 28 15:50:29.037540 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:29.043646 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:29.044134 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:29.044563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:29.045250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:29.045695 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:29.046146 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:29.047369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 362/713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:28 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:29.060688 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:29.061294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:29.067206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:29.068102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:29.068888 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:29.069594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:29.070040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:29.070486 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:29.256129 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:29.264103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:29.269666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ab47e45a-5eee-4388-bc63-420811af8b44 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1453 microversion: 2.1 time: 0.236567 Sep 28 15:50:29.273571 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 352/714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:29 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1453 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:29.278346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:29.279823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:29.280928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-88d8de6b-a8ca-4529-b707-8e719aed123e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1404 microversion: 2.20 time: 0.231951 Sep 28 15:50:29.281478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 363/715] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:29 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:30.066229 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:30.070086 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:30.076478 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:30.076891 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:30.077310 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:30.078172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:30.078632 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:30.079057 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:30.236806 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:30.252588 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ec433935-c79f-449b-8be4-8f02e0ba8ee1 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.189712 Sep 28 15:50:30.253192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 353/716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:30 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:30.310449 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:30.311057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:30.317767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:30.318260 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:30.318726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:30.319427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:30.319999 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:30.320427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:30.468418 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:30.477518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:30.479268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:30.480966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e1feb3b7-6615-4a0f-88b9-140a25920e2d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1404 microversion: 2.20 time: 0.175560 Sep 28 15:50:30.481889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 364/717] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:30 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:30.960473 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-fb36b438-a0a8-4e1e-94de-3ef62cd2e54f req-4a238f5b-f69e-4cf1-900a-0adbb76f7e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7", "tag": "d7f2b0b9-c545-4a35-bbc8-398e8c021de4"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:30.971416 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-fb36b438-a0a8-4e1e-94de-3ef62cd2e54f req-4a238f5b-f69e-4cf1-900a-0adbb76f7e7b service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:30.972174 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-fb36b438-a0a8-4e1e-94de-3ef62cd2e54f req-4a238f5b-f69e-4cf1-900a-0adbb76f7e7b service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:30.972603 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-fb36b438-a0a8-4e1e-94de-3ef62cd2e54f req-4a238f5b-f69e-4cf1-900a-0adbb76f7e7b service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:30.984598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-fb36b438-a0a8-4e1e-94de-3ef62cd2e54f req-4a238f5b-f69e-4cf1-900a-0adbb76f7e7b service nova] Creating event network-changed:d7f2b0b9-c545-4a35-bbc8-398e8c021de4 for instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 on hv-cinder-85931 Sep 28 15:50:30.990055 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-fb36b438-a0a8-4e1e-94de-3ef62cd2e54f req-4a238f5b-f69e-4cf1-900a-0adbb76f7e7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033126 Sep 28 15:50:30.991020 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 354/718] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:31.279154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:31.279768 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:31.286438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:31.287608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:31.288203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:31.289071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:31.290938 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:31.291214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:31.506471 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:31.507885 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:31.515246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:31.516027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:31.516623 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:31.517480 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:31.518087 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:31.518689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:31.565019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:31.575286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4353a6cf-86e0-4c26-b8af-7af7fc96d2dc tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.301879 Sep 28 15:50:31.593190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 365/719] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:31 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:31.757488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:31.768383 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:31.771072 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:31.772429 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5c635381-0791-4eda-b081-4a384e25319e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1404 microversion: 2.20 time: 0.270923 Sep 28 15:50:31.784225 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 355/720] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:31 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1404 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:50:32.602264 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:32.602910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:32.609831 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:32.610530 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:32.610781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:32.611662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:32.612141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:32.612557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:32.761610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:32.772329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9f352df5-cc9d-4ff8-9e00-d8d010cb80ee tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1756 microversion: 2.1 time: 0.173794 Sep 28 15:50:32.773651 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 366/721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:32 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:32.799459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:32.800087 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:32.806509 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:32.807013 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:32.807385 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:32.808245 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:32.808557 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:32.808959 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:32.894942 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:32.913482 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=6 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:32.945979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:32.954155 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:32.955622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:32.956710 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-565e5df3-ae39-4528-84bf-95435fa310e5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1404 microversion: 2.20 time: 0.161562 Sep 28 15:50:32.957255 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 356/722] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:32 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:33.632750 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-f9ee10f1-d558-4b41-8f6a-ae1a03412546 req-fd77998e-7905-4047-b512-d2dfc3a4223f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d6d0d-957f-4915-a855-0e3243c78b03", "name": "network-vif-plugged", "status": "completed", "tag": "5618ab50-2cf5-4a89-9eff-d989039147e5"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:33.641341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=6 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:33.646319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-f9ee10f1-d558-4b41-8f6a-ae1a03412546 req-fd77998e-7905-4047-b512-d2dfc3a4223f service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:33.647167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-f9ee10f1-d558-4b41-8f6a-ae1a03412546 req-fd77998e-7905-4047-b512-d2dfc3a4223f service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:33.647652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-f9ee10f1-d558-4b41-8f6a-ae1a03412546 req-fd77998e-7905-4047-b512-d2dfc3a4223f service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:33.664521 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-f9ee10f1-d558-4b41-8f6a-ae1a03412546 req-fd77998e-7905-4047-b512-d2dfc3a4223f service nova] Creating event network-vif-plugged:5618ab50-2cf5-4a89-9eff-d989039147e5 for instance 739d6d0d-957f-4915-a855-0e3243c78b03 on hv-cinder-85931 Sep 28 15:50:33.672079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-f9ee10f1-d558-4b41-8f6a-ae1a03412546 req-fd77998e-7905-4047-b512-d2dfc3a4223f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043005 Sep 28 15:50:33.672702 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 367/723] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:33.796460 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:33.797316 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:33.804125 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:33.804722 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:33.805082 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:33.805904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:33.806472 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:33.806892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:33.982917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:33.983603 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:33.989611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:33.990085 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:33.990534 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:33.991215 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:33.991660 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:33.992074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:34.016428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:34.024888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-188a94e7-c042-44ef-bbdd-4a3a43b0e765 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1759 microversion: 2.1 time: 0.232309 Sep 28 15:50:34.025563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 357/724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:33 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1759 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:34.125107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:34.133210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:34.134690 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:34.135795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-000ffc26-e4ba-49cb-b815-6ec58491d044 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1404 microversion: 2.20 time: 0.157263 Sep 28 15:50:34.136930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 368/725] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:33 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:50:35.161658 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:35.162241 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:35.169758 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:35.170243 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:35.170682 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:35.171358 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:35.171799 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:35.172206 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:35.301200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:35.310335 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:35.311809 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:35.312933 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-36b480a9-05b2-4f40-a267-655d20fd08be tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1404 microversion: 2.20 time: 0.155548 Sep 28 15:50:35.313519 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 358/726] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:35 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:36.337010 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:36.337712 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:36.344940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:36.345432 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:36.345858 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:36.346579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:36.347028 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:36.347445 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:36.484171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:36.493598 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:36.495065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:36.497031 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8472b068-9402-4a83-953a-e19475766da9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1596 microversion: 2.20 time: 0.163627 Sep 28 15:50:36.497557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 369/727] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:50:36 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1596 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:50:36.524838 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:36.525372 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:36.531658 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:36.532122 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:36.532541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:36.533214 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:36.533650 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:36.534060 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:36.616012 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3ed1b312-c0a9-48df-940f-769b64f10b7c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094986 Sep 28 15:50:36.616812 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 359/728] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 28 15:50:36 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:50:37.873030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-fe4ba805-821b-47e8-9f73-9c67cfffca98 req-18dcb642-9c8f-4f66-b06e-a331ccfb24b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739d6d0d-957f-4915-a855-0e3243c78b03", "tag": "5618ab50-2cf5-4a89-9eff-d989039147e5"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:37.883318 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-fe4ba805-821b-47e8-9f73-9c67cfffca98 req-18dcb642-9c8f-4f66-b06e-a331ccfb24b4 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:37.884263 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-fe4ba805-821b-47e8-9f73-9c67cfffca98 req-18dcb642-9c8f-4f66-b06e-a331ccfb24b4 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:37.884843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-fe4ba805-821b-47e8-9f73-9c67cfffca98 req-18dcb642-9c8f-4f66-b06e-a331ccfb24b4 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:37.899230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-fe4ba805-821b-47e8-9f73-9c67cfffca98 req-18dcb642-9c8f-4f66-b06e-a331ccfb24b4 service nova] Creating event network-changed:5618ab50-2cf5-4a89-9eff-d989039147e5 for instance 739d6d0d-957f-4915-a855-0e3243c78b03 on hv-cinder-85931 Sep 28 15:50:37.906265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-fe4ba805-821b-47e8-9f73-9c67cfffca98 req-18dcb642-9c8f-4f66-b06e-a331ccfb24b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036796 Sep 28 15:50:37.907138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 370/729] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:51:19.660792 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:19.662734 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=88 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:19.662934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:19.663739 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=94 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:19.668299 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-9ac7a4ff-ba05-4f12-a78f-e0823eb3f7d9 req-f1efd01a-e079-4888-b304-a166a46eab41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc8195d-c5bd-4e78-9001-13215dfedb9c", "tag": "6fe3578e-1526-411a-a9b7-3e91f28a36fb"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:19.669177 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:19.669841 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:19.678825 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:19.679676 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:19.679835 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9ac7a4ff-ba05-4f12-a78f-e0823eb3f7d9 req-f1efd01a-e079-4888-b304-a166a46eab41 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:19.680310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9ac7a4ff-ba05-4f12-a78f-e0823eb3f7d9 req-f1efd01a-e079-4888-b304-a166a46eab41 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:19.680438 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:19.680736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9ac7a4ff-ba05-4f12-a78f-e0823eb3f7d9 req-f1efd01a-e079-4888-b304-a166a46eab41 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:19.681114 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:19.681565 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:19.682004 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:19.693932 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-9ac7a4ff-ba05-4f12-a78f-e0823eb3f7d9 req-f1efd01a-e079-4888-b304-a166a46eab41 service nova] Creating event network-changed:6fe3578e-1526-411a-a9b7-3e91f28a36fb for instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c on hv-cinder-85931 Sep 28 15:51:19.699143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-9ac7a4ff-ba05-4f12-a78f-e0823eb3f7d9 req-f1efd01a-e079-4888-b304-a166a46eab41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037793 Sep 28 15:51:19.700448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 371/730] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:51:19.711788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Going to try to terminate instance {{(pid=126997) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:51:19.795219 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e9b6f513-a82f-4777-bd0a-76e44837514c tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 204 len: 0 microversion: 2.1 time: 0.135740 Sep 28 15:51:19.800553 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 360/731] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:51:19 2022] DELETE /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:51:19.808286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:19.809848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:19.816422 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:19.816918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:19.817362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:19.818075 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:19.818763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:19.819347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:19.988164 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:19.996597 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e7a0fd83-f1e2-4be3-8687-e7b4ac06c1f7 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.193694 Sep 28 15:51:19.997116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 372/732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:19 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:51:21.020743 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:21.021546 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:21.028907 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:21.029591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:21.030093 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:21.030962 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:21.031666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:21.032156 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:21.248611 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:21.265507 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-dcfec4f3-4ae0-4cb2-81a5-9fd4734e3100 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1570 microversion: 2.1 time: 0.242899 Sep 28 15:51:21.267132 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 361/733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:21 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:22.215141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-d82fd477-6edb-4bf0-a961-a69ebe25fc5d req-a88e0e30-c2a0-4b26-84c2-828fe4dc877a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc8195d-c5bd-4e78-9001-13215dfedb9c", "name": "network-vif-deleted", "tag": "6fe3578e-1526-411a-a9b7-3e91f28a36fb"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:22.226123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-d82fd477-6edb-4bf0-a961-a69ebe25fc5d req-a88e0e30-c2a0-4b26-84c2-828fe4dc877a service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:22.226839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-d82fd477-6edb-4bf0-a961-a69ebe25fc5d req-a88e0e30-c2a0-4b26-84c2-828fe4dc877a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:22.227465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-d82fd477-6edb-4bf0-a961-a69ebe25fc5d req-a88e0e30-c2a0-4b26-84c2-828fe4dc877a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:22.239134 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-d82fd477-6edb-4bf0-a961-a69ebe25fc5d req-a88e0e30-c2a0-4b26-84c2-828fe4dc877a service nova] Creating event network-vif-deleted:6fe3578e-1526-411a-a9b7-3e91f28a36fb for instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c on hv-cinder-85931 Sep 28 15:51:22.244058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-d82fd477-6edb-4bf0-a961-a69ebe25fc5d req-a88e0e30-c2a0-4b26-84c2-828fe4dc877a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Sep 28 15:51:22.245171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 373/734] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:51:22.284041 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:22.284915 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:22.291549 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:22.292005 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:22.292428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:22.293167 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:22.294292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:22.294292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:22.363036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:22.371888 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f679f1d5-c5b8-4ae9-906a-0b0ce0d9e258 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1219 microversion: 2.1 time: 0.091673 Sep 28 15:51:22.372459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 362/735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:22 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:23.396312 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:23.397009 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:23.403176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:23.403659 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:23.404093 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:23.404781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:23.405231 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:23.405650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:23.437472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:23.437948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:23.438375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:23.438845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lazy-loading 'fault' on Instance uuid 7cc8195d-c5bd-4e78-9001-13215dfedb9c {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:51:23.482838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca903cc98a24621b7c3be488e3e7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62283fd6a124de0a32ad8f586cf997e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:23.490966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-25dd6107-c315-4fad-b60b-7ec612435bbc tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 200 len: 1224 microversion: 2.1 time: 0.099310 Sep 28 15:51:23.491535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 374/736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:23 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:24.515249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:24.515800 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] [instance: 7cc8195d-c5bd-4e78-9001-13215dfedb9c] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:24.522228 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:24.522741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:24.523177 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:24.523860 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:24.524308 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:24.524733 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:24.538053 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] HTTP exception thrown: Instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c could not be found. Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Request method failure captured: Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c HTTP/1.1 Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNGvupr2GCtrGo18Q0cLhnsL6BuT5Rc5gc6PBzRXmPHS7l5YWj86JnNq_Y2G6ZoSQNtE6J6EBmyedZYojwH7_ovHdYqTnPkLJmyfWSYrMpyJ8D5uGicOxgCInXIHLRm9wDkZl5ORW0WaHylJQdDwWVbYuT-ByR-12ghncGYmQawcmtAg Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: b62283fd6a124de0a32ad8f586cf997e Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-TestShelveInstance-436905020 Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 15:51:24.539689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b62283fd6a124de0a32ad8f586cf997e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b62283fd6a124de0a32ad8f586cf997e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b62283fd6a124de0a32ad8f586cf997e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b62283fd6a124de0a32ad8f586cf997e"}]}] Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-TestShelveInstance-436905020 Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: b62283fd6a124de0a32ad8f586cf997e Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-TestShelveInstance-436905020 Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-TestShelveInstance-436905020-project Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 0ca903cc98a24621b7c3be488e3e7c5e Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-TestShelveInstance-436905020-project Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: > Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c could not be found. Sep 28 15:51:24.541237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'id': '7cc8195d-c5bd-4e78-9001-13215dfedb9c'} Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c could not be found. Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:51:24.542034 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c could not be found. Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c could not be found. Sep 28 15:51:24.543550 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 15:51:24.544950 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Returning 404 to user: Instance 7cc8195d-c5bd-4e78-9001-13215dfedb9c could not be found. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:51:24.544950 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-47ef04a5-039f-4198-acf6-d3fb43db8159 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c" status: 404 len: 111 microversion: 2.1 time: 0.030539 Sep 28 15:51:24.544950 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 363/737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:24 2022] GET /compute/v2.1/servers/7cc8195d-c5bd-4e78-9001-13215dfedb9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:51:24.703249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5ce9bd18-9570-493f-b587-829edc7baaf4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] Calling method '.version_select at 0x7f8fcfac8ee0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:24.724644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5ce9bd18-9570-493f-b587-829edc7baaf4 tempest-TestShelveInstance-436905020 tempest-TestShelveInstance-436905020-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1124873369" status: 202 len: 0 microversion: 2.1 time: 0.025361 Sep 28 15:51:24.725793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 375/738] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 28 15:51:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1124873369 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:51:41.251900 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-434113498"}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:41.252487 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:41.254599 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:41.255249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:41.262003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:41.262551 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:41.263084 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:41.263782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:41.264226 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:41.264654 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:41.393540 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.network.security_group_api [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Removing security group 6e2d7343-7dbd-4a1e-bae0-65a458597d71 from port fffc69bf-c846-46b6-872f-062d7c1cf28d Sep 28 15:51:41.705517 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-2fc073a2-8dbf-4033-bb15-de0b4d617222 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "POST /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/action" status: 202 len: 0 microversion: 2.1 time: 0.457789 Sep 28 15:51:41.706148 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 364/739] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:51:41 2022] POST /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:51:41.711436 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=18 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:41.712579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:41.717228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-b2f5f105-12bc-4474-ad10-e445fb2728c8 req-bc14e03c-0b69-47e1-806c-df61954f4964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2856eb9-043f-4d7d-972d-eef178a51b14", "tag": "fffc69bf-c846-46b6-872f-062d7c1cf28d"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:41.745628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b2f5f105-12bc-4474-ad10-e445fb2728c8 req-bc14e03c-0b69-47e1-806c-df61954f4964 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:41.746099 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b2f5f105-12bc-4474-ad10-e445fb2728c8 req-bc14e03c-0b69-47e1-806c-df61954f4964 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:41.746559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b2f5f105-12bc-4474-ad10-e445fb2728c8 req-bc14e03c-0b69-47e1-806c-df61954f4964 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:41.768190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-b2f5f105-12bc-4474-ad10-e445fb2728c8 req-bc14e03c-0b69-47e1-806c-df61954f4964 service nova] Creating event network-changed:fffc69bf-c846-46b6-872f-062d7c1cf28d for instance f2856eb9-043f-4d7d-972d-eef178a51b14 on hv-cinder-85931 Sep 28 15:51:41.773469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-b2f5f105-12bc-4474-ad10-e445fb2728c8 req-bc14e03c-0b69-47e1-806c-df61954f4964 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063539 Sep 28 15:51:41.774089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 376/740] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:51:42.757091 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:42.757850 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:42.759512 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-e1e1adee-8a9f-4cb4-8fb9-9ce26fbf228b req-8aef0ae4-2b04-4ff3-9caf-24c63ddc2ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2856eb9-043f-4d7d-972d-eef178a51b14", "tag": "fffc69bf-c846-46b6-872f-062d7c1cf28d"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:42.764239 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:42.764793 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:42.765292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:42.766070 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:42.766622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:42.767120 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:42.769600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e1e1adee-8a9f-4cb4-8fb9-9ce26fbf228b req-8aef0ae4-2b04-4ff3-9caf-24c63ddc2ad3 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:42.770256 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e1e1adee-8a9f-4cb4-8fb9-9ce26fbf228b req-8aef0ae4-2b04-4ff3-9caf-24c63ddc2ad3 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:42.770774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e1e1adee-8a9f-4cb4-8fb9-9ce26fbf228b req-8aef0ae4-2b04-4ff3-9caf-24c63ddc2ad3 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:42.782178 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-e1e1adee-8a9f-4cb4-8fb9-9ce26fbf228b req-8aef0ae4-2b04-4ff3-9caf-24c63ddc2ad3 service nova] Creating event network-changed:fffc69bf-c846-46b6-872f-062d7c1cf28d for instance f2856eb9-043f-4d7d-972d-eef178a51b14 on hv-cinder-85931 Sep 28 15:51:42.788164 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-e1e1adee-8a9f-4cb4-8fb9-9ce26fbf228b req-8aef0ae4-2b04-4ff3-9caf-24c63ddc2ad3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033179 Sep 28 15:51:42.789288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 377/741] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:51:42.852544 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lazy-loading 'services' on Instance uuid f2856eb9-043f-4d7d-972d-eef178a51b14 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:51:42.934988 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-3ba86a71-5f53-4801-98d4-bf3e935ce98a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments/005e4f20-80ba-49b7-ae08-2248da1a1589" status: 202 len: 0 microversion: 2.1 time: 0.182384 Sep 28 15:51:42.936200 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 365/742] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 15:51:42 2022] DELETE /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments/005e4f20-80ba-49b7-ae08-2248da1a1589 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:51:42.945000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:42.947363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:42.959910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:42.960493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:42.961206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:42.961976 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:42.962476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:42.962866 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:43.013762 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e85eab70-42d0-48b3-8e0e-ddd6a4008101 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073199 Sep 28 15:51:43.014345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 378/743] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:51:42 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:51:44.027059 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:44.029349 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:44.035500 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:44.035979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:44.036404 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:44.037083 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:44.037527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:44.037943 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:44.066685 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-67b3b366-aa35-47b7-af9e-46d82124e9b2 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044236 Sep 28 15:51:44.067150 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 366/744] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:51:44 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:51:44.078521 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:44.079073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:44.085477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:44.085955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:44.086387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:44.087185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:44.087629 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:44.088076 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:44.162199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] HTTP exception thrown: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 is not attached to volume 005e4f20-80ba-49b7-ae08-2248da1a1589 Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Request method failure captured: Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments/005e4f20-80ba-49b7-ae08-2248da1a1589 HTTP/1.1 Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGykAPCEgDMH38KT_Xqgd91XpJqVC4DEGVWuxX9IjPvtGvUQhr5tOWEaDCzNNzeFKUg59_kLIevTDKo_iKWUSX4hIbwPVfXAVOexyhi2oTDn9ALm_f5VTTc3L05NMdypoPaAc41v7QRXBJ2pevOVB8w7_lhFiLhkPD_p7gQgG8wHDXM Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: f3eec134d5864a3c82f27706eb8065fa Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-TestMinimumBasicScenario-1918909073 Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:51:44.164577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f3eec134d5864a3c82f27706eb8065fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f3eec134d5864a3c82f27706eb8065fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f3eec134d5864a3c82f27706eb8065fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f3eec134d5864a3c82f27706eb8065fa"}]}] Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-TestMinimumBasicScenario-1918909073 Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: f3eec134d5864a3c82f27706eb8065fa Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1918909073 Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-TestMinimumBasicScenario-1918909073-project Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 525cdc42a473486ba64b481cf2820d31 Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-TestMinimumBasicScenario-1918909073-project Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:51:44.166102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 is not attached to volume 005e4f20-80ba-49b7-ae08-2248da1a1589 Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'server_id': 'f2856eb9-043f-4d7d-972d-eef178a51b14', 'id': '005e4f20-80ba-49b7-ae08-2248da1a1589'} Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 005e4f20-80ba-49b7-ae08-2248da1a1589. Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:51:44.167520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 is not attached to volume 005e4f20-80ba-49b7-ae08-2248da1a1589 Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 is not attached to volume 005e4f20-80ba-49b7-ae08-2248da1a1589 Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:44.168951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Returning 404 to user: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 is not attached to volume 005e4f20-80ba-49b7-ae08-2248da1a1589 {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:51:44.170033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4aa72ffb-1500-4eb1-8bd3-f66416137c90 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments/005e4f20-80ba-49b7-ae08-2248da1a1589" status: 404 len: 154 microversion: 2.1 time: 0.091534 Sep 28 15:51:44.170033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 379/745] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 15:51:44 2022] DELETE /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14/os-volume_attachments/005e4f20-80ba-49b7-ae08-2248da1a1589 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:51:45.306970 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:45.308003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:45.314289 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:45.314788 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:45.315211 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:45.315879 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:45.316316 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:45.316727 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:45.341204 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Going to try to terminate instance {{(pid=126997) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:51:45.413027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b2f32268-898a-4e90-8343-3555ae91ee5a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 204 len: 0 microversion: 2.1 time: 0.108979 Sep 28 15:51:45.414160 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 367/746] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:51:45 2022] DELETE /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:51:45.422315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:45.423032 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:45.429704 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:45.430171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:45.430623 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:45.431301 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:45.431738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:45.432147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:45.567411 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:45.575615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f276a6ea-35d3-4863-85b0-d5b76946dc38 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1555 microversion: 2.1 time: 0.157247 Sep 28 15:51:45.576169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 380/747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:45 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:51:46.599432 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:46.600031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:46.606303 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:46.606799 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:46.607221 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:46.607889 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:46.608326 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:46.608736 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:46.736188 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:46.743844 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c206dcd0-785c-416d-83ac-8c08889b1c73 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1555 microversion: 2.1 time: 0.148620 Sep 28 15:51:46.744406 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 368/748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:46 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:47.768272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:47.769247 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:47.775927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:47.776408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:47.776837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:47.777525 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:47.777970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:47.778388 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:47.994714 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-35345f2c-63c9-47df-955a-cfa21f1b39ad req-b0fa52b1-8182-428d-b628-4dcbdfdc4c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2856eb9-043f-4d7d-972d-eef178a51b14", "name": "network-vif-deleted", "tag": "fffc69bf-c846-46b6-872f-062d7c1cf28d"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:47.999786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525cdc42a473486ba64b481cf2820d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eec134d5864a3c82f27706eb8065fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:48.008499 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-35345f2c-63c9-47df-955a-cfa21f1b39ad req-b0fa52b1-8182-428d-b628-4dcbdfdc4c07 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:48.009089 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-35345f2c-63c9-47df-955a-cfa21f1b39ad req-b0fa52b1-8182-428d-b628-4dcbdfdc4c07 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:48.009461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-35345f2c-63c9-47df-955a-cfa21f1b39ad req-b0fa52b1-8182-428d-b628-4dcbdfdc4c07 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:48.012737 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-14b9dc41-375b-4059-b3df-b82a79e18e27 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 200 len: 1555 microversion: 2.1 time: 0.249023 Sep 28 15:51:48.022941 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-35345f2c-63c9-47df-955a-cfa21f1b39ad req-b0fa52b1-8182-428d-b628-4dcbdfdc4c07 service nova] Creating event network-vif-deleted:fffc69bf-c846-46b6-872f-062d7c1cf28d for instance f2856eb9-043f-4d7d-972d-eef178a51b14 on hv-cinder-85931 Sep 28 15:51:48.024880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 381/749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:47 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:48.029489 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-35345f2c-63c9-47df-955a-cfa21f1b39ad req-b0fa52b1-8182-428d-b628-4dcbdfdc4c07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037871 Sep 28 15:51:48.030313 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 369/750] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:51:49.039366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:49.039977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] [instance: f2856eb9-043f-4d7d-972d-eef178a51b14] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:49.047132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:49.047591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:49.048018 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:49.048711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:49.049155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:49.049572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:49.062998 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] HTTP exception thrown: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 could not be found. Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Request method failure captured: Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 HTTP/1.1 Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGykAPCEgDMH38KT_Xqgd91XpJqVC4DEGVWuxX9IjPvtGvUQhr5tOWEaDCzNNzeFKUg59_kLIevTDKo_iKWUSX4hIbwPVfXAVOexyhi2oTDn9ALm_f5VTTc3L05NMdypoPaAc41v7QRXBJ2pevOVB8w7_lhFiLhkPD_p7gQgG8wHDXM Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: f3eec134d5864a3c82f27706eb8065fa Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-TestMinimumBasicScenario-1918909073 Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:51:49.064490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f3eec134d5864a3c82f27706eb8065fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f3eec134d5864a3c82f27706eb8065fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f3eec134d5864a3c82f27706eb8065fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f3eec134d5864a3c82f27706eb8065fa"}]}] Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-TestMinimumBasicScenario-1918909073 Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: f3eec134d5864a3c82f27706eb8065fa Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1918909073 Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-TestMinimumBasicScenario-1918909073-project Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 525cdc42a473486ba64b481cf2820d31 Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-TestMinimumBasicScenario-1918909073-project Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 could not be found. Sep 28 15:51:49.066205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'f2856eb9-043f-4d7d-972d-eef178a51b14'} Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 could not be found. Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:51:49.067079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 could not be found. Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 could not be found. Sep 28 15:51:49.068588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:51:49.070033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Returning 404 to user: Instance f2856eb9-043f-4d7d-972d-eef178a51b14 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:51:49.070033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cb3fe3cf-eb0a-4eaa-8e3f-ff0d9a2fd90a tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14" status: 404 len: 111 microversion: 2.1 time: 0.031548 Sep 28 15:51:49.070033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 382/751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:49 2022] GET /compute/v2.1/servers/f2856eb9-043f-4d7d-972d-eef178a51b14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:51:49.075396 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1bd6bbab-f662-4f49-88f2-08556b8fcea8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] Calling method '.version_select at 0x7f8fcbbd2af0>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:49.094507 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1bd6bbab-f662-4f49-88f2-08556b8fcea8 tempest-TestMinimumBasicScenario-1918909073 tempest-TestMinimumBasicScenario-1918909073-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-363951845" status: 202 len: 0 microversion: 2.1 time: 0.023605 Sep 28 15:51:49.095072 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 370/752] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 28 15:51:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-363951845 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:51:57.524756 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:57.525319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:57.532036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:57.532749 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:57.533184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:57.533907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:57.534353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:57.534820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:57.561147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-abf95dc7-7937-4e70-b288-3194f20a71dd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/ips" status: 200 len: 152 microversion: 2.20 time: 0.040390 Sep 28 15:51:57.561733 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 383/753] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 28 15:51:57 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:51:59.933589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:59.934786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:59.938845 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:59.939500 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:59.948623 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:59.949110 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:59.949546 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:59.951026 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:59.951478 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:59.951895 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:59.981525 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lazy-loading 'flavor' on Instance uuid 739d6d0d-957f-4915-a855-0e3243c78b03 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:52:00.167479 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e427ff8f-abb5-4284-aad7-a08e3eb18c58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/action" status: 202 len: 0 microversion: 2.20 time: 0.235142 Sep 28 15:52:00.168097 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 371/754] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 28 15:51:59 2022] POST /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:52:00.176253 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:00.176947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:00.184461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:00.184844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:00.185275 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:00.185969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:00.186431 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:00.186880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:00.317895 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:00.326704 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:00.328163 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:00.329317 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2d58d19f-24eb-4653-9449-f39d4f53a9f2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.156929 Sep 28 15:52:00.329878 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 384/755] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:00 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:01.355089 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:01.355786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:01.363075 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:01.363558 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:01.363982 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:01.364663 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:01.365104 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:01.365523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:01.492613 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:01.500738 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:01.502175 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:01.503342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-d563bc2d-dfc1-4ef7-ba97-39bc24f04dd4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.153005 Sep 28 15:52:01.503891 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 372/756] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:01 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:02.529375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:02.530026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:02.536478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:02.536964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:02.537402 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:02.538096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:02.538579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:02.539004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:02.674737 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:02.683175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:02.684600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:02.685739 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-39daf18b-4557-41ff-bc29-54a1fe2806cf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.160977 Sep 28 15:52:02.686293 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 385/757] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:02 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:03.711387 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:03.712332 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:03.718991 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:03.719463 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:03.719892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:03.720572 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:03.721012 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:03.721429 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:03.847160 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:03.855101 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:03.857049 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:03.858188 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6984e16c-bc2f-421e-b185-5c3b9f639cf2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.151145 Sep 28 15:52:03.858777 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 373/758] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:03 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:04.884058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:04.884612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:04.891712 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:04.892199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:04.892625 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:04.893365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:04.893742 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:04.894159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:05.024176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:05.032429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:05.033879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:05.035061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-84b9b725-050a-4a5d-9f25-8c048f7d7dc9 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.154978 Sep 28 15:52:05.035619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 386/759] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:04 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:06.060400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:06.061012 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:06.067429 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:06.067903 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:06.068336 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:06.069019 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:06.069468 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:06.069889 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:06.196123 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:06.204651 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:06.206094 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:06.207271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-2d91a0c1-94e5-4c55-a4db-928d82686e0e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.150769 Sep 28 15:52:06.207832 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 374/760] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:06 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:07.233289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:07.233889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:07.240312 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:07.240787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:07.241215 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:07.241896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:07.242342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:07.242784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:07.372750 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:07.380847 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:07.382329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:07.383511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8b1bf821-3b21-48ac-89bd-be0fb436213d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.154741 Sep 28 15:52:07.384079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 387/761] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:07 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:08.408038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:08.408641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:08.415056 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:08.415534 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:08.415964 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:08.416646 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:08.417119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:08.417511 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:08.548127 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:08.556437 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:08.557875 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:08.559095 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-9cf28c7e-5b91-4be7-a449-4b26a3db5532 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.154923 Sep 28 15:52:08.559656 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 375/762] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:08 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:09.585403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:09.585952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:09.592497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:09.592969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:09.593423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:09.594097 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:09.594573 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:09.594987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:09.723626 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:09.732155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:09.733598 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:09.734761 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fc4f011a-c8de-41c3-869d-a87b95551a33 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.153270 Sep 28 15:52:09.735318 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 388/763] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:09 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:10.760123 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:10.760643 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:10.767835 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:10.768298 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:10.768721 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:10.769389 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:10.769823 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:10.770233 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:10.906720 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:10.914657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:10.916080 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:10.917218 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-7f2b8c43-546e-4dc4-bea4-9cc5b6b1b4ee tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.161137 Sep 28 15:52:10.917773 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 376/764] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:10 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:11.944071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:11.944672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:11.947130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=27 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:11.954046 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:11.954843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:11.955471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:11.956516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:11.957197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:11.957861 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:11.963896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=65 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:12.104689 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:12.112912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:12.114406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:12.115576 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-79fd13fe-490a-4df1-886a-e485b0d52164 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.175670 Sep 28 15:52:12.116135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 389/765] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:11 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:13.140229 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:13.140833 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:13.147561 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:13.148039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:13.148467 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:13.149153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:13.149598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:13.150016 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:13.283339 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:13.291386 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:13.292810 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:13.294621 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0f7aa086-393f-4dc0-ab55-607310b9ba58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.158306 Sep 28 15:52:13.295170 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 377/766] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:13 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:14.319591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:14.320195 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:14.326879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:14.327357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:14.327792 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:14.328476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:14.328923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:14.329341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:14.457132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:14.465690 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:14.467161 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:14.468315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5fe6b368-186e-42db-9e71-d0ccd5187b27 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.152619 Sep 28 15:52:14.468879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 390/767] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:14 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:15.494119 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:15.494752 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:15.501610 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:15.502092 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:15.502555 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:15.503243 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:15.503689 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:15.504107 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:15.630781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:15.638901 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:15.640328 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:15.641459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-12d8b2dc-d450-4c7a-a2a8-ff482c42e5bd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.151285 Sep 28 15:52:15.642011 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 378/768] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:15 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:16.665874 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:16.666520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:16.672922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:16.673403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:16.673826 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:16.674539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:16.674989 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:16.675441 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:16.814483 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:16.821507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:16.822983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:16.824131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8034e86d-5c85-40b6-a99f-c03eebc366b0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1742 microversion: 2.20 time: 0.162191 Sep 28 15:52:16.825298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 391/769] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:16 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:17.849995 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:17.850577 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:17.857591 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:17.858063 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:17.858519 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:17.859193 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:17.859635 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:17.860047 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:17.988600 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:17.997073 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:17.998555 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:17.999693 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c05cbafa-53b4-4f32-916c-da0754c06eb4 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1742 microversion: 2.20 time: 0.153639 Sep 28 15:52:18.000248 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 379/770] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:17 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:19.026983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:19.027583 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:19.033947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:19.034432 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:19.034864 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:19.035543 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:19.035984 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:19.036389 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:19.168829 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:19.176841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:19.178557 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:19.179701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a5513582-4346-4097-8137-39a28a6826d0 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1742 microversion: 2.20 time: 0.156683 Sep 28 15:52:19.180258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 392/771] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:19 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:20.205529 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:20.206132 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:20.212692 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:20.213179 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:20.213606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:20.214326 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:20.215478 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:20.215904 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:20.345269 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:20.353348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:20.354823 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:20.356015 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-814c312b-8a8a-4f0e-8b02-2f559dd52b58 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1742 microversion: 2.20 time: 0.154351 Sep 28 15:52:20.356581 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 380/772] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:20 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:21.381854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:21.382515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:21.390458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:21.391217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:21.391837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:21.392726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:21.393208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:21.393631 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:21.536926 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:21.547745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:21.549431 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:21.550739 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6a66fb83-49f3-437e-bf67-9c0f8eae2b93 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.173359 Sep 28 15:52:21.551508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 393/773] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:21 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:22.066499 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-a049c956-34ce-4b04-91eb-3abac1eb03c3 req-0c7d283c-1f56-4024-b14c-a6294112273a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d6d0d-957f-4915-a855-0e3243c78b03", "name": "network-vif-plugged", "status": "completed", "tag": "5618ab50-2cf5-4a89-9eff-d989039147e5"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:22.084373 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-a049c956-34ce-4b04-91eb-3abac1eb03c3 req-0c7d283c-1f56-4024-b14c-a6294112273a service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:22.084842 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-a049c956-34ce-4b04-91eb-3abac1eb03c3 req-0c7d283c-1f56-4024-b14c-a6294112273a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:22.085261 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-a049c956-34ce-4b04-91eb-3abac1eb03c3 req-0c7d283c-1f56-4024-b14c-a6294112273a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:22.106604 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-a049c956-34ce-4b04-91eb-3abac1eb03c3 req-0c7d283c-1f56-4024-b14c-a6294112273a service nova] Creating event network-vif-plugged:5618ab50-2cf5-4a89-9eff-d989039147e5 for instance 739d6d0d-957f-4915-a855-0e3243c78b03 on hv-cinder-85931 Sep 28 15:52:22.112832 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-a049c956-34ce-4b04-91eb-3abac1eb03c3 req-0c7d283c-1f56-4024-b14c-a6294112273a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050026 Sep 28 15:52:22.113927 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 381/774] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:52:22.577586 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:22.578169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:22.584968 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:22.585581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:22.586013 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:22.586714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:22.587409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:22.587878 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:22.732594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:22.740782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:22.742674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:22.744160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-66a393ff-1310-44c3-ba7b-defcad31e87e tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.171023 Sep 28 15:52:22.744717 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 394/775] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:22 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:23.769744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:23.770459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:23.778086 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:23.778600 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:23.779036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:23.779744 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:23.780192 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:23.780616 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:23.923774 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:23.932175 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:23.933722 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:23.934821 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-09b816d5-b31d-402f-b671-1f7afd8a4417 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.169396 Sep 28 15:52:23.935741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 382/776] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:23 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:24.961055 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:24.962283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:24.969879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:24.970361 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:24.971005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:24.971786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:24.972190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:24.972609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:25.122107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:25.130884 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:25.132342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:25.133499 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4f5fc229-f1e9-4656-8d8f-fb931cc0a8eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.176465 Sep 28 15:52:25.134049 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 395/777] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:24 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:26.164582 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:26.165362 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:26.171740 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:26.172215 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:26.172633 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:26.173322 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:26.173760 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:26.174180 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:26.322068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:26.331578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:26.333131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:26.334378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-fb4863cb-05c1-4b9d-8e36-898553bb3c4d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.177953 Sep 28 15:52:26.350936 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 383/778] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:26 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:27.361564 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:27.362174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:27.369345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:27.369914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:27.370450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:27.371233 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:27.371739 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:27.372252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:27.556185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:27.566288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:27.569004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:27.571781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-105e93b8-4eca-49fd-8b23-5f001511537d tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.213865 Sep 28 15:52:27.572578 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 396/779] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:27 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:52:28.597280 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:28.598545 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:28.605372 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:28.606137 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:28.606610 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:28.607310 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:28.607757 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:28.608176 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:28.756560 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:28.769814 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:28.771405 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:28.773114 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-0f1035e3-c5d2-4add-a673-cc8fd5639bdd tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.179556 Sep 28 15:52:28.773372 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 384/780] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:28 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:29.802194 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:29.802816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:29.809806 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:29.810702 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:29.811353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:29.812276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:29.812969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:29.813456 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:29.954391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:29.962916 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:29.965471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:29.966638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b416ac03-61f0-4b8c-989d-c7145fdefda8 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.168593 Sep 28 15:52:29.967823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 397/781] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:29 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:30.994853 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:30.995458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:30.997644 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=29 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:31.002708 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:31.003182 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:31.003613 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:31.004289 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:31.004734 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:31.005152 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:31.008140 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:31.137291 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:31.145173 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:31.146641 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:31.147786 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-df493bc3-f30f-4949-974f-b808dc1402a6 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1737 microversion: 2.20 time: 0.156873 Sep 28 15:52:31.148339 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 385/782] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:30 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:32.174173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:32.174732 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:32.181658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:32.182138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:32.182605 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:32.183291 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:32.183737 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:32.184155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:32.314219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:32.322232 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:32.323703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:32.324851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d1d0b802-a743-4338-b5f1-6c89da8b5d3a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1719 microversion: 2.20 time: 0.154669 Sep 28 15:52:32.325417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 398/783] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:32 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:33.349926 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:33.350555 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:33.357891 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:33.358371 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:33.358854 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:33.359539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:33.359988 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:33.360406 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:33.493433 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:33.501967 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:33.503434 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:33.504589 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-702167e4-8314-4f83-892a-2446c15b817c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1719 microversion: 2.20 time: 0.158579 Sep 28 15:52:33.505203 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 386/784] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:33 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:34.530581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:34.531104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:34.537482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:34.537958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:34.538383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:34.539086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:34.539550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:34.539965 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:34.669544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:34.677920 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:34.679413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:34.680553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2eade9ff-ef34-4043-9ad7-80b51f9f4678 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1662 microversion: 2.20 time: 0.154709 Sep 28 15:52:34.681120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 399/785] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:34 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:34.705838 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5528913-5d85-4bce-878c-397887303b71"}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:34.708131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:34.714436 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:34.714920 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:34.715342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:34.716010 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:34.716445 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:34.716853 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:34.993389 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-99e2ebf8-c367-410e-a8de-7afc013cbaca tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291492 Sep 28 15:52:34.993987 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 387/786] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 28 15:52:34 2022] POST /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:52:35.120300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:35.120873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:35.127632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:35.128109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:35.128537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:35.129218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:35.129665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:35.130111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:35.365825 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8b2b9493-3c35-4f62-9c25-4d87dbe1c5f3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/os-volume_attachments/f5528913-5d85-4bce-878c-397887303b71" status: 202 len: 0 microversion: 2.20 time: 0.249450 Sep 28 15:52:35.366717 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 400/787] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 28 15:52:35 2022] DELETE /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/os-volume_attachments/f5528913-5d85-4bce-878c-397887303b71 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:52:35.428669 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:35.429246 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:35.435853 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:35.436324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:35.436748 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:35.437427 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:35.437869 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:35.438282 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:35.468036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126997) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 15:52:35.532760 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-9e577d11-bd93-4cf0-ae47-fd9a568b0081 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "POST /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/action" status: 202 len: 0 microversion: 2.20 time: 0.108223 Sep 28 15:52:35.536958 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 388/788] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 28 15:52:35 2022] POST /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:52:35.542369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:35.543574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:35.550231 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:35.550761 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:35.551193 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:35.552173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:35.552644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:35.553107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:35.848978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:35.857462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:35.858929 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:35.860076 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-73d381fe-e18e-421e-9b6a-f1d9e093fe51 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1670 microversion: 2.20 time: 0.321856 Sep 28 15:52:35.860632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 401/789] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:35 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1670 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:36.146241 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-5aa76f78-b261-4ab3-ae5b-8bef28aa3495 req-efedc606-a1cc-46a8-96bc-2c001b898497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d6d0d-957f-4915-a855-0e3243c78b03", "name": "network-vif-unplugged", "status": "completed", "tag": "5618ab50-2cf5-4a89-9eff-d989039147e5"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:36.156826 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-5aa76f78-b261-4ab3-ae5b-8bef28aa3495 req-efedc606-a1cc-46a8-96bc-2c001b898497 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:36.157303 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-5aa76f78-b261-4ab3-ae5b-8bef28aa3495 req-efedc606-a1cc-46a8-96bc-2c001b898497 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:36.158353 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-5aa76f78-b261-4ab3-ae5b-8bef28aa3495 req-efedc606-a1cc-46a8-96bc-2c001b898497 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:36.174449 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.compute.server_external_events [req-5aa76f78-b261-4ab3-ae5b-8bef28aa3495 req-efedc606-a1cc-46a8-96bc-2c001b898497 service nova] Unable to find a host for instance 739d6d0d-957f-4915-a855-0e3243c78b03. Dropping event network-vif-unplugged {{(pid=126997) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 28 15:52:36.175343 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-5aa76f78-b261-4ab3-ae5b-8bef28aa3495 req-efedc606-a1cc-46a8-96bc-2c001b898497 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033622 Sep 28 15:52:36.175932 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 389/790] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 28 15:52:36.885147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:36.886446 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:36.892982 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:36.893400 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:36.893829 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:36.894542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:36.895022 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:36.895436 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:37.115401 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:37.123481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:37.124909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:37.126059 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3afa81b8-2b4b-4b00-9af8-00f40900a13c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.244864 Sep 28 15:52:37.126638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 402/791] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:36 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:38.151585 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:38.152378 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:38.159298 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:38.159817 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:38.160263 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:38.160950 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:38.161461 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:38.161922 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:38.310649 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:38.318780 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:38.320271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:38.321437 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ad47a01a-efb6-47e8-b3c1-5995b6c9a041 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.174288 Sep 28 15:52:38.321998 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 390/792] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:38 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:39.347692 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:39.348303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:39.354836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:39.355320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:39.355773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:39.356495 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:39.356951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:39.357367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:39.361420 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:39.495890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:39.505761 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:39.507583 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:39.508855 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-05a6235f-a24b-41e0-bcb4-a86ba34f62ba tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.165043 Sep 28 15:52:39.509513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 403/793] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:39 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:40.535540 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:40.536151 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:40.544763 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:40.545290 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:40.545734 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:40.546396 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:40.546875 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:40.547320 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:40.697742 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:40.707039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:40.708731 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:40.710451 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-31f2b86e-5545-40e5-a114-977a8474046c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.179139 Sep 28 15:52:40.713802 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 391/794] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:40 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:52:41.736785 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:41.737383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:41.744025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:41.744503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:41.744931 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:41.745643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:41.746064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:41.746575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:41.888019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:41.896712 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:41.898210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:41.899409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ea68b2e0-ace1-443a-9dd0-5252344f6daf tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.166548 Sep 28 15:52:41.900332 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 404/795] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:41 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:42.927250 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:42.928581 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:42.935693 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:42.936206 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:42.936643 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:42.937354 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:42.938249 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:42.938713 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:43.309324 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:43.317693 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:43.319294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:43.320480 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-96c5d6ee-5db2-44a2-852e-c46b9b8361d3 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.398615 Sep 28 15:52:43.321041 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 392/796] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:42 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:44.349517 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:44.351607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:44.360178 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=32 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:44.362615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:44.363214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:44.363743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:44.364520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:44.365045 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:44.365538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:44.504858 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:44.513459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:44.515123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:44.516322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-18e095bb-7d05-42dc-b3a3-77dd9dc62681 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.172201 Sep 28 15:52:44.531016 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 405/797] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:44 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:45.542607 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:45.543678 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:45.550130 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:45.550639 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:45.551068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:45.552007 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:45.552444 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:45.552855 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:45.679862 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:45.692003 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:45.693941 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:45.696645 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f0884b00-71bf-47e7-ad9d-10e6ea9b4f7a tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.158024 Sep 28 15:52:45.697213 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 393/798] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:45 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:46.722852 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:46.723502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:46.729947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:46.730447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:46.730896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:46.731585 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:46.732035 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:46.732458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:46.916589 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:46.927240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:46.929031 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:46.930381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6a4f3150-f561-4569-a935-875c68e95046 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.211445 Sep 28 15:52:46.930963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 406/799] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:46 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:47.956472 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:47.957071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:47.963481 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:47.963960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:47.964385 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:47.965088 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:47.965527 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:47.965977 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:48.095309 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:48.103366 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:48.104806 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:48.105945 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-21b03ec9-8547-4434-9894-44a68d6486a2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.153450 Sep 28 15:52:48.106523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 394/800] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:47 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:49.132169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:49.132751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:49.139218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:49.139699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:49.140132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:49.140820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:49.141273 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:49.141694 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:49.277024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:49.285949 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:49.287418 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:49.288583 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bde2bc82-7878-406d-91cd-d29ea2d3ef55 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.160373 Sep 28 15:52:49.289156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 407/801] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:49 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:50.314923 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:50.315523 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:50.321936 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:50.322431 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:50.322866 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:50.323543 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:50.323987 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:50.324400 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:50.455632 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:50.464163 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:50.465625 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:50.467303 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-89e4d1a1-fdc6-4ca2-a458-00db0b98a499 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.156237 Sep 28 15:52:50.467866 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 395/802] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:50 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:51.493034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:51.493638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:51.500596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:51.501072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:51.501519 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:51.502206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:51.502680 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:51.503100 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:51.634838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:51.642920 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:51.644354 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:51.645501 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-578da47f-d652-4e70-bd4d-3afcd5dc2fc1 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.156451 Sep 28 15:52:51.646048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 408/803] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:51 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:52.670481 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:52.671087 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:52.677688 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:52.678164 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:52.678625 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:52.679307 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:52.679756 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:52.680172 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:52.809180 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:52.817618 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:52.819072 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:52.820201 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-ddb856f3-f54a-4014-b041-37f96278e0d7 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.153723 Sep 28 15:52:52.820750 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 396/804] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:52 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:53.846145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:53.846719 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:53.852601 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:53.853079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:53.853507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:53.854218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:53.854695 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:53.855118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:53.984068 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:53.992605 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:53.994051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:53.995245 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b34d7d79-5539-4742-a714-8bfb8a94b85c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.153349 Sep 28 15:52:53.995790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 409/805] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:53 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:55.020947 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:55.021586 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:55.034564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:55.035069 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:55.035462 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:55.036153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:55.036592 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:55.036996 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:55.277926 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:55.286913 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:55.288348 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:55.289498 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-787e8a18-1eda-4271-831b-023be5b35e56 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.273323 Sep 28 15:52:55.290052 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 397/806] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:55 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:56.257130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-621ac74b-2c9b-45ec-b33a-18da69e8c9f4 req-1da2221a-0fcf-49d3-b91d-c01dafbe0750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d6d0d-957f-4915-a855-0e3243c78b03", "name": "network-vif-plugged", "status": "completed", "tag": "5618ab50-2cf5-4a89-9eff-d989039147e5"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:56.268462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-621ac74b-2c9b-45ec-b33a-18da69e8c9f4 req-1da2221a-0fcf-49d3-b91d-c01dafbe0750 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:56.269003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-621ac74b-2c9b-45ec-b33a-18da69e8c9f4 req-1da2221a-0fcf-49d3-b91d-c01dafbe0750 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:56.269511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-621ac74b-2c9b-45ec-b33a-18da69e8c9f4 req-1da2221a-0fcf-49d3-b91d-c01dafbe0750 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:56.280907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-621ac74b-2c9b-45ec-b33a-18da69e8c9f4 req-1da2221a-0fcf-49d3-b91d-c01dafbe0750 service nova] Creating event network-vif-plugged:5618ab50-2cf5-4a89-9eff-d989039147e5 for instance 739d6d0d-957f-4915-a855-0e3243c78b03 on hv-cinder-85931 Sep 28 15:52:56.286270 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-621ac74b-2c9b-45ec-b33a-18da69e8c9f4 req-1da2221a-0fcf-49d3-b91d-c01dafbe0750 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 Sep 28 15:52:56.286903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 410/807] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:52:56.315474 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:56.316151 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:56.322558 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:56.323036 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:56.323512 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:56.324187 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:56.324564 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:56.324980 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:56.456258 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:56.458486 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:56.466453 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:56.468210 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:56.469602 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e7c492ca-5faa-4586-9003-9cc6d0c4a604 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.157995 Sep 28 15:52:56.470549 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 398/808] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:56 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:57.496680 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:57.497943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:57.504615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:57.505103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:57.505537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:57.506237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:57.506716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:57.507140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:57.646818 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:57.655080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:57.656536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:57.657715 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a246acb8-4852-492c-9873-d89aa9963f39 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.165878 Sep 28 15:52:57.658280 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 411/809] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:57 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:58.683540 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:58.684131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:58.692210 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:58.692685 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:58.693109 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:58.693785 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:58.694225 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:58.694662 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:58.827060 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:58.835444 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:58.836892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:58.838063 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-b6512086-b9ba-45a6-8848-c02014033833 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1728 microversion: 2.20 time: 0.158418 Sep 28 15:52:58.838782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 399/810] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:58 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:52:59.867199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:59.867806 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:59.874830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:59.875322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:59.875763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:59.876463 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:59.876915 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:59.877339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:00.005894 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:00.015180 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:00.016200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:00.017383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a3158a3e-c22a-4225-b57d-d152dbefc97c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1715 microversion: 2.20 time: 0.154123 Sep 28 15:53:00.017941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 412/811] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:52:59 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:53:00.465690 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-70c64e33-a5d4-49a6-8de9-0e3fa21ba65c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2083909748", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1385565331", "security_groups": [{"name": "tempest-secgroup-smoke-714818131"}], "block_device_mapping_v2": [{"uuid": "4ea81b7e-a8f4-4914-8fc1-190123b7892f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6eae24b-3c95-4cde-9586-a8891b23b1a7"}]}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:53:00.577466 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-70c64e33-a5d4-49a6-8de9-0e3fa21ba65c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] validate_networks() for [('b6eae24b-3c95-4cde-9586-a8891b23b1a7', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:53:08.831069 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=7 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:53:10.478492 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:53:55.419269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:55.421977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:55.424344 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=15 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:53:55.425210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=54 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:53:55.432187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:55.432668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:55.433101 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:55.433789 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:55.434245 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:55.434698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:55.465217 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ac80b7bb-eeca-46e7-a88f-cf7777b235eb tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049835 Sep 28 15:53:55.465777 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 413/812] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 28 15:53:55 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:53:55.533886 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:55.534310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:55.540240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:55.540717 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:55.541150 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:55.541832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:55.542282 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:55.542742 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:55.567523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:53:55.646714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-847589a6-4fa2-4d56-87cb-996901600b2c tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 204 len: 0 microversion: 2.20 time: 0.116920 Sep 28 15:53:55.647738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 414/813] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 28 15:53:55 2022] DELETE /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 28 15:53:55.656664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:55.657345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:55.663304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:55.663774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:55.664197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:55.664870 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:55.665308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:55.665722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:55.794298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:55.802759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:55.804441 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:55.805607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-27b9fdee-81d6-43c5-99a9-13f0757cb341 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.153704 Sep 28 15:53:55.806167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 415/814] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:53:55 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:53:56.831109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:56.831771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:56.838074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:56.838579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:56.839009 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:56.839687 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:56.840123 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:56.840534 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:56.989308 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:56.999627 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:57.001365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:57.002792 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1a3602f9-6df8-46a8-bed3-cd0e0feb5fb2 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.175391 Sep 28 15:53:57.003501 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 416/815] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:53:56 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:53:58.029204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:58.029880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:58.038114 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:58.038638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:58.039069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:58.039765 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:58.040202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:58.040614 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:58.268565 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:58.277254 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:58.278874 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ecdfa3c79f84cc29061dd5ebfa60101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7541b0dd8b14bf495094ddaa132bc2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:58.280588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e359f78e-bb7f-4c95-8979-fa88e9ac16fc tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 200 len: 1721 microversion: 2.20 time: 0.255280 Sep 28 15:53:58.281315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 417/816] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:53:58 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:53:58.741671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-7c63eb3a-55fe-4f97-94d9-a3bd83d432f2 req-e99f42e7-6b20-496c-83c7-1ce1ee1ce143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d6d0d-957f-4915-a855-0e3243c78b03", "name": "network-vif-deleted", "tag": "5618ab50-2cf5-4a89-9eff-d989039147e5"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:53:58.755333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-7c63eb3a-55fe-4f97-94d9-a3bd83d432f2 req-e99f42e7-6b20-496c-83c7-1ce1ee1ce143 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:58.755750 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-7c63eb3a-55fe-4f97-94d9-a3bd83d432f2 req-e99f42e7-6b20-496c-83c7-1ce1ee1ce143 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:58.756190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-7c63eb3a-55fe-4f97-94d9-a3bd83d432f2 req-e99f42e7-6b20-496c-83c7-1ce1ee1ce143 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:58.770639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-7c63eb3a-55fe-4f97-94d9-a3bd83d432f2 req-e99f42e7-6b20-496c-83c7-1ce1ee1ce143 service nova] Creating event network-vif-deleted:5618ab50-2cf5-4a89-9eff-d989039147e5 for instance 739d6d0d-957f-4915-a855-0e3243c78b03 on hv-cinder-85931 Sep 28 15:53:58.782378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-7c63eb3a-55fe-4f97-94d9-a3bd83d432f2 req-e99f42e7-6b20-496c-83c7-1ce1ee1ce143 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114773 Sep 28 15:53:58.783377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 418/817] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:53:59.308005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:59.308793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:59.315492 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:59.315988 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:59.316428 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:59.317185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:59.317646 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:59.318073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:59.333224 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] HTTP exception thrown: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Request method failure captured: Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 HTTP/1.1 Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGvdlJ7nByKUesvQpusQEtXz3LNqP2lkHDxJZz-TSenHyaY0SmSvrvP6vr26Hu2M4IQkPIYQGB9pwZ3vfnT3cEkcROtsg6hPjh367OblBvWFY9OnB8Yu1xa9ktjSB5VHNGa9HGpi1JZXBaXaTNSBaYIDS9QMarbmyYdIhlqS48rrmMA Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:53:59.334987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c7541b0dd8b14bf495094ddaa132bc2a"}]}] Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 9ecdfa3c79f84cc29061dd5ebfa60101 Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:53:59.336655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '739d6d0d-957f-4915-a855-0e3243c78b03'} Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:53:59.337641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:53:59.339752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:53:59.341522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Returning 404 to user: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:53:59.341522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-45470b54-a226-4e6e-bf76-46ea6bf4e050 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 404 len: 111 microversion: 2.20 time: 0.033627 Sep 28 15:53:59.341522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 419/818] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:53:59 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 28 15:53:59.345844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e3dfef95-45d7-473e-825c-68e786046a6f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '.version_select at 0x7f8fcf981280>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:59.350735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3dfef95-45d7-473e-825c-68e786046a6f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [e07937fe-6c5b-43ce-8557-8d151e002d8d] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 15:54:00.357923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3dfef95-45d7-473e-825c-68e786046a6f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [e07937fe-6c5b-43ce-8557-8d151e002d8d] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 41796. Sep 28 15:54:00.377026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e3dfef95-45d7-473e-825c-68e786046a6f tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39493001" status: 204 len: 0 microversion: 2.20 time: 1.035508 Sep 28 15:54:00.377599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 420/819] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 28 15:53:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39493001 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 28 15:54:02.166581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:02.167191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:02.173622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:02.174106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:02.174575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:02.175267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:02.175720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:02.176145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:02.191232 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] HTTP exception thrown: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Request method failure captured: Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 HTTP/1.1 Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGvdlJ7nByKUesvQpusQEtXz3LNqP2lkHDxJZz-TSenHyaY0SmSvrvP6vr26Hu2M4IQkPIYQGB9pwZ3vfnT3cEkcROtsg6hPjh367OblBvWFY9OnB8Yu1xa9ktjSB5VHNGa9HGpi1JZXBaXaTNSBaYIDS9QMarbmyYdIhlqS48rrmMA Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:54:02.192987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c7541b0dd8b14bf495094ddaa132bc2a"}]}] Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 9ecdfa3c79f84cc29061dd5ebfa60101 Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.194807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '739d6d0d-957f-4915-a855-0e3243c78b03'} Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:54:02.195919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.197552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.199173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Returning 404 to user: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:54:02.199173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a5a8e726-d697-4b5d-b028-2d3e8504ca64 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 404 len: 111 microversion: 2.20 time: 0.032453 Sep 28 15:54:02.199173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 421/820] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 28 15:54:02 2022] DELETE /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 28 15:54:02.203063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:02.203662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: 739d6d0d-957f-4915-a855-0e3243c78b03] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:02.209379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:02.209859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:02.210288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:02.211005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:02.211455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:02.211876 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:02.225413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] HTTP exception thrown: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Request method failure captured: Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 HTTP/1.1 Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGvdlJ7nByKUesvQpusQEtXz3LNqP2lkHDxJZz-TSenHyaY0SmSvrvP6vr26Hu2M4IQkPIYQGB9pwZ3vfnT3cEkcROtsg6hPjh367OblBvWFY9OnB8Yu1xa9ktjSB5VHNGa9HGpi1JZXBaXaTNSBaYIDS9QMarbmyYdIhlqS48rrmMA Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:54:02.226964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c7541b0dd8b14bf495094ddaa132bc2a"}]}] Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 9ecdfa3c79f84cc29061dd5ebfa60101 Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.228620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '739d6d0d-957f-4915-a855-0e3243c78b03'} Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:54:02.229408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. Sep 28 15:54:02.230671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:02.232052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Returning 404 to user: Instance 739d6d0d-957f-4915-a855-0e3243c78b03 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:54:02.232052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a421ca29-bb7d-41df-b774-188f74070d74 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03" status: 404 len: 111 microversion: 2.20 time: 0.028882 Sep 28 15:54:02.232052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 422/821] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:54:02 2022] GET /compute/v2.1/servers/739d6d0d-957f-4915-a855-0e3243c78b03 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 28 15:54:03.368561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:03.369182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:03.376198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.376682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.377135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.377818 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.378269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.378725 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.392916 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] HTTP exception thrown: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Request method failure captured: Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a HTTP/1.1 Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGvdlJ7nByKUesvQpusQEtXz3LNqP2lkHDxJZz-TSenHyaY0SmSvrvP6vr26Hu2M4IQkPIYQGB9pwZ3vfnT3cEkcROtsg6hPjh367OblBvWFY9OnB8Yu1xa9ktjSB5VHNGa9HGpi1JZXBaXaTNSBaYIDS9QMarbmyYdIhlqS48rrmMA Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:54:03.394509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c7541b0dd8b14bf495094ddaa132bc2a"}]}] Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 9ecdfa3c79f84cc29061dd5ebfa60101 Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.395880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'e1b859de-bccb-472f-ab94-ede851f23b9a'} Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:54:03.396754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.398535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.400797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Returning 404 to user: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:54:03.400797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-54e66d9f-a4ce-4c03-aecf-f218e2ae7dc5 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 404 len: 111 microversion: 2.20 time: 0.031260 Sep 28 15:54:03.400797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 423/822] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 28 15:54:03 2022] DELETE /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 28 15:54:03.404301 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:03.404893 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] [instance: e1b859de-bccb-472f-ab94-ede851f23b9a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:03.410829 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.411297 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.411725 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.412397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.412834 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.413244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.427379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] HTTP exception thrown: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Request method failure captured: Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a HTTP/1.1 Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGvdlJ7nByKUesvQpusQEtXz3LNqP2lkHDxJZz-TSenHyaY0SmSvrvP6vr26Hu2M4IQkPIYQGB9pwZ3vfnT3cEkcROtsg6hPjh367OblBvWFY9OnB8Yu1xa9ktjSB5VHNGa9HGpi1JZXBaXaTNSBaYIDS9QMarbmyYdIhlqS48rrmMA Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:54:03.428941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c7541b0dd8b14bf495094ddaa132bc2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c7541b0dd8b14bf495094ddaa132bc2a"}]}] Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: c7541b0dd8b14bf495094ddaa132bc2a Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960823757 Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 9ecdfa3c79f84cc29061dd5ebfa60101 Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960823757-project Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.430613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'e1b859de-bccb-472f-ab94-ede851f23b9a'} Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:54:03.431363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. Sep 28 15:54:03.432637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:03.433769 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] Returning 404 to user: Instance e1b859de-bccb-472f-ab94-ede851f23b9a could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:54:03.433769 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-69088d67-3ac5-4cdf-89ff-57ee71292c98 tempest-AttachVolumeShelveTestJSON-1960823757 tempest-AttachVolumeShelveTestJSON-1960823757-project] 10.222.0.60 "GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a" status: 404 len: 111 microversion: 2.20 time: 0.029936 Sep 28 15:54:03.433769 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 424/823] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 28 15:54:03 2022] GET /compute/v2.1/servers/e1b859de-bccb-472f-ab94-ede851f23b9a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 28 15:54:03.647487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:03.648078 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:03.654651 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.655404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.655828 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.656720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.657168 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.657582 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.690190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:54:03.777894 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-38df52d8-896b-4f03-87ad-82e9cde809d2 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 204 len: 0 microversion: 2.1 time: 0.134231 Sep 28 15:54:03.779061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 425/824] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:54:03 2022] DELETE /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:54:03.787546 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-e952c3a0-0d1f-4d77-8449-23420b5c325e req-f78829f6-19f8-4543-9839-7218c17c2e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7", "tag": "d7f2b0b9-c545-4a35-bbc8-398e8c021de4"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:03.798486 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e952c3a0-0d1f-4d77-8449-23420b5c325e req-f78829f6-19f8-4543-9839-7218c17c2e41 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.799063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e952c3a0-0d1f-4d77-8449-23420b5c325e req-f78829f6-19f8-4543-9839-7218c17c2e41 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.799487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e952c3a0-0d1f-4d77-8449-23420b5c325e req-f78829f6-19f8-4543-9839-7218c17c2e41 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.811192 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-e952c3a0-0d1f-4d77-8449-23420b5c325e req-f78829f6-19f8-4543-9839-7218c17c2e41 service nova] Creating event network-changed:d7f2b0b9-c545-4a35-bbc8-398e8c021de4 for instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 on hv-cinder-85931 Sep 28 15:54:03.817188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-e952c3a0-0d1f-4d77-8449-23420b5c325e req-f78829f6-19f8-4543-9839-7218c17c2e41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034663 Sep 28 15:54:03.817188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 426/825] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:54:03.821721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:03.822433 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:03.830806 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.831458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.832292 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.833039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:03.833660 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:03.834081 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:03.982380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:03.990745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d0cc305c-5c9d-42f6-abdc-c77f66742422 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1578 microversion: 2.1 time: 0.172888 Sep 28 15:54:03.991334 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 427/826] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:03 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:05.015922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:05.016594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:05.027157 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:05.027654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:05.028081 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:05.030910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:05.031546 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:05.031975 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:05.186648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:05.201252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7a9bbeb9-4627-4999-9b9f-0ebc26069240 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1578 microversion: 2.1 time: 0.190922 Sep 28 15:54:05.201839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 428/827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:05 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:06.225614 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:06.227069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:06.235078 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:06.235571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:06.236053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:06.236752 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:06.237578 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:06.238204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:06.340869 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88f34e4fc44e432d9e994ae5dcdbd1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcffff710dd74209b30a1d02fb2bec46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:06.352678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0bd89bc9-d1f3-499f-85b4-d0fa748843b8 tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 200 len: 1392 microversion: 2.1 time: 0.131108 Sep 28 15:54:06.362453 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 429/828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:06 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 1392 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:06.362453 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-a6262899-2c65-4740-9ccf-e51df990155a req-331b0611-0bd9-4185-993d-f100699c5e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7", "name": "network-vif-deleted", "tag": "d7f2b0b9-c545-4a35-bbc8-398e8c021de4"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:06.368333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-a6262899-2c65-4740-9ccf-e51df990155a req-331b0611-0bd9-4185-993d-f100699c5e48 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:06.368986 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-a6262899-2c65-4740-9ccf-e51df990155a req-331b0611-0bd9-4185-993d-f100699c5e48 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:06.369256 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-a6262899-2c65-4740-9ccf-e51df990155a req-331b0611-0bd9-4185-993d-f100699c5e48 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:06.383254 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-a6262899-2c65-4740-9ccf-e51df990155a req-331b0611-0bd9-4185-993d-f100699c5e48 service nova] Creating event network-vif-deleted:d7f2b0b9-c545-4a35-bbc8-398e8c021de4 for instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 on hv-cinder-85931 Sep 28 15:54:06.389858 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-a6262899-2c65-4740-9ccf-e51df990155a req-331b0611-0bd9-4185-993d-f100699c5e48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034971 Sep 28 15:54:06.390916 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 430/829] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:54:07.375469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:07.376190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:07.382750 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:07.383225 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:07.383654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:07.384342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:07.384824 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:07.385369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:07.402909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] HTTP exception thrown: Instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 could not be found. Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Request method failure captured: Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 HTTP/1.1 Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGw-HGf-N9WuZzhUZR3MYCgIqZIQYbhR_2uKFhO4JTLY6R8V8pNmvygKUeo8UumD-WutoEQADxKxMKB2hCk2YDSVKPguh4beV86EzSSLsujHIYYWWWt6tNWqekcf6iT7rVjwxDz81taytjO7GLkxCcorVGEmHBucE-33Y_URjVQfGyw Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: bcffff710dd74209b30a1d02fb2bec46 Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:54:07.405038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bcffff710dd74209b30a1d02fb2bec46"}]}] Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: bcffff710dd74209b30a1d02fb2bec46 Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-TestVolumeBootPattern-1295971202-project Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 88f34e4fc44e432d9e994ae5dcdbd1ae Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-TestVolumeBootPattern-1295971202-project Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 could not be found. Sep 28 15:54:07.406664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7'} Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 could not be found. Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:54:07.407596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 could not be found. Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 could not be found. Sep 28 15:54:07.409130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.410731 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Returning 404 to user: Instance 6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:54:07.410731 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-64b67d36-a21e-40da-b6cc-09d9e2c2d31f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7" status: 404 len: 111 microversion: 2.1 time: 0.035210 Sep 28 15:54:07.410731 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 431/830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:07 2022] GET /compute/v2.1/servers/6dda5c07-c9f5-4ba7-a83d-622fa75cb3a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:54:07.906683 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:07.907573 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:07.913366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:07.913822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:07.914256 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:07.915079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:07.915431 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:07.915853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:07.930049 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] HTTP exception thrown: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Request method failure captured: Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 HTTP/1.1 Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGw-HGf-N9WuZzhUZR3MYCgIqZIQYbhR_2uKFhO4JTLY6R8V8pNmvygKUeo8UumD-WutoEQADxKxMKB2hCk2YDSVKPguh4beV86EzSSLsujHIYYWWWt6tNWqekcf6iT7rVjwxDz81taytjO7GLkxCcorVGEmHBucE-33Y_URjVQfGyw Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: bcffff710dd74209b30a1d02fb2bec46 Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:54:07.931667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bcffff710dd74209b30a1d02fb2bec46"}]}] Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: bcffff710dd74209b30a1d02fb2bec46 Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-TestVolumeBootPattern-1295971202-project Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 88f34e4fc44e432d9e994ae5dcdbd1ae Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-TestVolumeBootPattern-1295971202-project Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.933237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '31a8645e-d57d-45ff-b0e3-686164f46a86'} Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:54:07.934198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.936713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.938810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Returning 404 to user: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:54:07.938810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-265d369d-ea8c-4155-971d-bc91775a7a3f tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "DELETE /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 404 len: 111 microversion: 2.1 time: 0.031260 Sep 28 15:54:07.938810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 432/831] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:54:07 2022] DELETE /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:54:07.941674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:07.942994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] [instance: 31a8645e-d57d-45ff-b0e3-686164f46a86] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:07.948914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:07.949402 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:07.949867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:07.950600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:07.951556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:07.951978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:07.966541 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] HTTP exception thrown: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Request method failure captured: Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 HTTP/1.1 Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNGw-HGf-N9WuZzhUZR3MYCgIqZIQYbhR_2uKFhO4JTLY6R8V8pNmvygKUeo8UumD-WutoEQADxKxMKB2hCk2YDSVKPguh4beV86EzSSLsujHIYYWWWt6tNWqekcf6iT7rVjwxDz81taytjO7GLkxCcorVGEmHBucE-33Y_URjVQfGyw Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: bcffff710dd74209b30a1d02fb2bec46 Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:54:07.968810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bcffff710dd74209b30a1d02fb2bec46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bcffff710dd74209b30a1d02fb2bec46"}]}] Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: bcffff710dd74209b30a1d02fb2bec46 Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-TestVolumeBootPattern-1295971202 Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-TestVolumeBootPattern-1295971202-project Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 88f34e4fc44e432d9e994ae5dcdbd1ae Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-TestVolumeBootPattern-1295971202-project Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.970487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '31a8645e-d57d-45ff-b0e3-686164f46a86'} Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:54:07.971497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. Sep 28 15:54:07.973109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:54:07.974892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Returning 404 to user: Instance 31a8645e-d57d-45ff-b0e3-686164f46a86 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:54:07.974892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f07720b4-7f4b-4438-b8c3-92c9c10c1ddc tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86" status: 404 len: 111 microversion: 2.1 time: 0.032195 Sep 28 15:54:07.974892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 433/832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:07 2022] GET /compute/v2.1/servers/31a8645e-d57d-45ff-b0e3-686164f46a86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:54:09.311980 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-754956ee-65de-4983-8262-11b4ae761b1b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Calling method '.version_select at 0x7f8fcfadc790>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:09.334993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-754956ee-65de-4983-8262-11b4ae761b1b tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1385565331" status: 202 len: 0 microversion: 2.1 time: 0.030073 Sep 28 15:54:09.335809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 434/833] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 28 15:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1385565331 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:54:13.333685 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-10cb822f-b08b-43af-97bf-d9aa68118c96 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'create', calling method: .version_select at 0x7f8fcfc42a60>, body: {"keypair": {"name": "tempest-keypair-1530665565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnr2xpKCBhuGAKCSDO4YS2PISLOEjKvmyeCikoQlrLxvOFlhzp6NSjiFoJ5fXDU3pEkwHn5M7wPGjnWrhLsKCXqJ7Ci4LeZ8otJY8uFCFjtN+zaY4+f89hNobAk/oYQeA=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:13.363621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-10cb822f-b08b-43af-97bf-d9aa68118c96 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Getting quotas for project 0891d5f021664ff6b39f555c63ee5e5e. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:54:13.368269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-10cb822f-b08b-43af-97bf-d9aa68118c96 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Getting quotas for user dae4ea8a6f5b4fc686bb07d31090ba3b and project 0891d5f021664ff6b39f555c63ee5e5e. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:54:13.402342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-10cb822f-b08b-43af-97bf-d9aa68118c96 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.258713 Sep 28 15:54:13.403146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 435/834] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 15:54:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:54:15.125385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-839088467", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bef0f3be-4b54-4e83-80ee-c06d6d4e657b"}], "security_groups": [{"name": "tempest-securitygroup--1880656115"}], "key_name": "tempest-keypair-1530665565", "user_data": "}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:15.594922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] validate_networks() for [('bef0f3be-4b54-4e83-80ee-c06d6d4e657b', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:54:16.302789 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:54:16.303355 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:54:16.303733 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:54:16.304144 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:54:16.304810 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:54:16.317885 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:16.318370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:16.318850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:16.319639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:16.319979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:16.320399 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:16.383555 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Getting quotas for project 0891d5f021664ff6b39f555c63ee5e5e. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:54:16.390329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Getting quotas for user dae4ea8a6f5b4fc686bb07d31090ba3b and project 0891d5f021664ff6b39f555c63ee5e5e. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:54:16.404341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:54:16.414207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:54:16.478697 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3e57a862-a3d7-4bc7-89bf-eeef62bbf571 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.358952 Sep 28 15:54:16.479567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 436/835] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:54:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 15:54:16.491195 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a6be31a1-85c4-45a0-bf23-dfff1569cb01 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:16.491816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a6be31a1-85c4-45a0-bf23-dfff1569cb01 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:16.600260 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a6be31a1-85c4-45a0-bf23-dfff1569cb01 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:16.608670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a6be31a1-85c4-45a0-bf23-dfff1569cb01 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1237 microversion: 2.1 time: 0.121552 Sep 28 15:54:16.609607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 437/836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:16 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1237 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:17.634457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:17.635921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:17.643309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:17.644264 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:17.644968 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:17.645964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:17.646666 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:17.647331 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:17.654788 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:17.766214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:17.775289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ffd919e0-8411-49a5-b7e6-a6a8ddf1fbe1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1289 microversion: 2.1 time: 0.145629 Sep 28 15:54:17.787899 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 438/837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:17 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1289 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:18.801418 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:18.802770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:18.813390 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:18.814326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:18.815016 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:18.816019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:18.816859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:18.817667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:19.069120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:19.084762 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6a60cd08-0c96-4cd2-b0bf-6c0d26c895ac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1363 microversion: 2.1 time: 0.287310 Sep 28 15:54:19.094741 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 439/838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:18 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:19.695204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-6cd1cbc8-1c2b-4664-a344-ac82abb525c3 req-e6da44b4-f487-4248-930b-33427f69ca5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e69977b-2822-4e56-a25f-2683098b6ebb", "tag": "3a57dfac-efe7-416f-8aee-5ccc5d541be3"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:19.702218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:19.706644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6cd1cbc8-1c2b-4664-a344-ac82abb525c3 req-e6da44b4-f487-4248-930b-33427f69ca5d service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:19.707132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6cd1cbc8-1c2b-4664-a344-ac82abb525c3 req-e6da44b4-f487-4248-930b-33427f69ca5d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:19.707572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6cd1cbc8-1c2b-4664-a344-ac82abb525c3 req-e6da44b4-f487-4248-930b-33427f69ca5d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:19.723150 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-6cd1cbc8-1c2b-4664-a344-ac82abb525c3 req-e6da44b4-f487-4248-930b-33427f69ca5d service nova] Creating event network-changed:3a57dfac-efe7-416f-8aee-5ccc5d541be3 for instance 9e69977b-2822-4e56-a25f-2683098b6ebb on hv-cinder-85931 Sep 28 15:54:19.728088 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-6cd1cbc8-1c2b-4664-a344-ac82abb525c3 req-e6da44b4-f487-4248-930b-33427f69ca5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037395 Sep 28 15:54:19.728662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 440/839] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:54:20.110273 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:20.111104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:20.119057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:20.119474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:20.119943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:20.120607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:20.121049 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:20.121480 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:20.324326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:20.332814 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c247c941-3667-4b07-8cbf-b8650adaee5b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1363 microversion: 2.1 time: 0.227173 Sep 28 15:54:20.333385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 441/840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:20 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:21.355104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:21.355729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:21.362160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:21.362686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:21.363133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:21.363812 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:21.364258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:21.364665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:21.491267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:21.499504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4a8d5075-14c2-4a74-bcf8-a0dd5704b691 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1363 microversion: 2.1 time: 0.148382 Sep 28 15:54:21.500073 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 442/841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:21 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:22.522363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:22.523048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:22.529778 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:22.530257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:22.530706 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:22.531387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:22.531827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:22.532234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:22.665290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:22.673160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ba260c22-e911-45c9-b730-f2e560e4180b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1363 microversion: 2.1 time: 0.154562 Sep 28 15:54:22.673745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 443/842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:22 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:23.696712 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:23.697388 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:23.704302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:23.704782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:23.705213 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:23.705899 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:23.706350 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:23.706794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:23.840845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:23.849201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ccea3d91-2730-48e4-917c-482809e1e032 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1363 microversion: 2.1 time: 0.156285 Sep 28 15:54:23.849786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 444/843] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:23 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:24.860066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-94c76ccf-c3bf-466b-afac-048cffc4096b req-ac0c4cd6-1b36-4e33-9b10-503e709c01cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e69977b-2822-4e56-a25f-2683098b6ebb", "name": "network-vif-plugged", "status": "completed", "tag": "3a57dfac-efe7-416f-8aee-5ccc5d541be3"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:24.869865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-94c76ccf-c3bf-466b-afac-048cffc4096b req-ac0c4cd6-1b36-4e33-9b10-503e709c01cb service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:24.870337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-94c76ccf-c3bf-466b-afac-048cffc4096b req-ac0c4cd6-1b36-4e33-9b10-503e709c01cb service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:24.870796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-94c76ccf-c3bf-466b-afac-048cffc4096b req-ac0c4cd6-1b36-4e33-9b10-503e709c01cb service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:24.881970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-94c76ccf-c3bf-466b-afac-048cffc4096b req-ac0c4cd6-1b36-4e33-9b10-503e709c01cb service nova] Creating event network-vif-plugged:3a57dfac-efe7-416f-8aee-5ccc5d541be3 for instance 9e69977b-2822-4e56-a25f-2683098b6ebb on hv-cinder-85931 Sep 28 15:54:24.887071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-94c76ccf-c3bf-466b-afac-048cffc4096b req-ac0c4cd6-1b36-4e33-9b10-503e709c01cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207727 Sep 28 15:54:24.887670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 445/844] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:54:24.893142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:24.893851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:24.899778 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:24.900264 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:24.900698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:24.901387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:24.901866 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:24.902288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:25.037799 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:25.046284 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3ccb8d56-d8f0-4333-a04f-6ba3730cc59d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1363 microversion: 2.1 time: 0.157490 Sep 28 15:54:25.046898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 446/845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:24 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:26.070164 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:26.070870 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:26.077391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:26.077869 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:26.078307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:26.079011 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:26.079455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:26.079892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:26.211094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:26.219172 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7408a40f-1e93-49eb-bdc2-c270e7f40bce tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1363 microversion: 2.1 time: 0.152891 Sep 28 15:54:26.219739 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 447/846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:26 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:27.243251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:27.243925 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:27.245950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:27.246685 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=12 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:27.253857 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:27.254346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:27.254802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:27.255539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:27.255995 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:27.256415 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:27.385808 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:27.393540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-eed697af-f306-4a34-9900-a5ff4b78f277 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1548 microversion: 2.1 time: 0.154718 Sep 28 15:54:27.394103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 448/847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:27 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:27.414734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:27.415214 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:27.421338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:27.421807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:27.422233 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:27.422940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:27.423385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:27.423799 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:27.499655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3eb90880-05bf-49ed-bbd6-65439c69aeac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088412 Sep 28 15:54:27.500251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 449/848] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 15:54:27 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:54:28.681182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-2e76e2cd-6ef9-41a7-8824-ad6b6d7ae610 req-d646d819-fcda-4cbc-9a40-e3d8f21e83c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e69977b-2822-4e56-a25f-2683098b6ebb", "tag": "3a57dfac-efe7-416f-8aee-5ccc5d541be3"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:28.691239 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2e76e2cd-6ef9-41a7-8824-ad6b6d7ae610 req-d646d819-fcda-4cbc-9a40-e3d8f21e83c3 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:28.691706 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2e76e2cd-6ef9-41a7-8824-ad6b6d7ae610 req-d646d819-fcda-4cbc-9a40-e3d8f21e83c3 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:28.692330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2e76e2cd-6ef9-41a7-8824-ad6b6d7ae610 req-d646d819-fcda-4cbc-9a40-e3d8f21e83c3 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:28.703455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-2e76e2cd-6ef9-41a7-8824-ad6b6d7ae610 req-d646d819-fcda-4cbc-9a40-e3d8f21e83c3 service nova] Creating event network-changed:3a57dfac-efe7-416f-8aee-5ccc5d541be3 for instance 9e69977b-2822-4e56-a25f-2683098b6ebb on hv-cinder-85931 Sep 28 15:54:28.708320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-2e76e2cd-6ef9-41a7-8824-ad6b6d7ae610 req-d646d819-fcda-4cbc-9a40-e3d8f21e83c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031513 Sep 28 15:54:28.708910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 450/849] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:55:08.005776 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:55:08.006338 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 15:55:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 15:55:19.945731 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:55:19.946516 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 15:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 15:55:19.947782 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:55:19.947914 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 15:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 15:55:33.343617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=20 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:55:33.344367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=62 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:55:33.349283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:33.349864 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:33.357203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:33.357688 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:33.358124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:33.358852 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:33.359302 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:33.359726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:33.383502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0f0fded4-df73-406a-8b28-370b0536c4e8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/ips" status: 200 len: 144 microversion: 2.1 time: 0.042120 Sep 28 15:55:33.384003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 451/850] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 15:55:33 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:55:36.328028 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fff1e39-dd26-41d5-9329-7cc45b2a70f1"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:55:36.330338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:36.337212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:36.337692 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:36.338132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:36.338850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:36.339304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:36.339730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:36.608432 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-25d8e464-fb27-49db-87e4-d674a6e623b6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284079 Sep 28 15:55:36.609137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 452/851] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 15:55:36 2022] POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:55:44.146612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-241ac629-e506-446f-b37d-226b74af3c6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:55:44.153417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-241ac629-e506-446f-b37d-226b74af3c6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:44.153891 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-241ac629-e506-446f-b37d-226b74af3c6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:44.154321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-241ac629-e506-446f-b37d-226b74af3c6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:44.214832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-241ac629-e506-446f-b37d-226b74af3c6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Going to try to stop instance {{(pid=126996) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 15:55:44.259329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-241ac629-e506-446f-b37d-226b74af3c6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/action" status: 202 len: 0 microversion: 2.1 time: 0.116770 Sep 28 15:55:44.259923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 453/852] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:55:44 2022] POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:55:44.269638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:44.270327 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:44.276593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:44.277158 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:44.277619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:44.278460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:44.279043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:44.280034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:44.411299 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:44.419491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-492d6d12-dfd0-43f7-8916-811edf6e5369 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.154604 Sep 28 15:55:44.420154 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 454/853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:44 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:45.442379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:45.443094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:45.449429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:45.449910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:45.450340 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:45.451058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:45.451505 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:45.451927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:45.582352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:45.590547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-85d0b6e9-1941-49a3-bb5c-dee31e9ec6db tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.152101 Sep 28 15:55:45.591122 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 455/854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:45 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:46.613917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:46.614601 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:46.620957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:46.621439 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:46.621877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:46.622598 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:46.623051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:46.623470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:46.756174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:46.764488 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f97b77d5-944e-41ce-90b7-5739472a50aa tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.155066 Sep 28 15:55:46.765071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 456/855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:46 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:47.787405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:47.788053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:47.794492 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:47.794982 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:47.795419 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:47.796115 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:47.796565 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:47.796985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:47.924712 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:47.933148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d68f1af8-8e4f-4069-a3b3-95c5a8ce5df7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.149670 Sep 28 15:55:47.933765 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 457/856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:47 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:48.957207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:48.957881 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:48.964275 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:48.964755 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:48.965186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:48.965877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:48.966324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:48.966781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:49.098492 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:49.106615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-716c5fc0-dc6d-4266-bdbf-bc24936d5f46 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.154031 Sep 28 15:55:49.107184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 458/857] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:48 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:50.129187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:50.129881 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:50.136184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:50.136672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:50.137098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:50.137779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:50.138225 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:50.138664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:50.271560 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:50.279793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e66b2f4e-5781-4b9f-a983-c3d8442f0c18 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.154588 Sep 28 15:55:50.280359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 459/858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:50 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:51.304802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:51.305506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:51.312026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:51.312513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:51.312945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:51.313640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:51.314092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:51.314551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:51.456948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:51.466687 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-816e5fd4-d2b6-435b-8b28-2124a7a8d776 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.165764 Sep 28 15:55:51.467259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 460/859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:51 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:52.491023 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:52.491702 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:52.498823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:52.499303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:52.499734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:52.501012 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:52.501012 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:52.501373 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:52.628784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:52.637636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fe15aa60-6f81-43e9-bb4e-5a8aaede94f8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.151047 Sep 28 15:55:52.638279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 461/860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:52 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:53.661287 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:53.661981 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:53.668320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:53.668804 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:53.669244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:53.669933 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:53.670385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:53.670830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:53.799436 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:53.807940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f0a323f0-001f-4b20-bcf9-835f30c3e75a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1722 microversion: 2.1 time: 0.150605 Sep 28 15:55:53.808505 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 462/861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:53 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:54.832915 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:54.833622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:54.840106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:54.840580 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:54.841007 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:54.841690 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:54.842133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:54.842579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:54.972057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:54.980267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-533561f5-afd3-44a1-838b-6346130d89b3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1699 microversion: 2.1 time: 0.151752 Sep 28 15:55:54.980829 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 463/862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:54 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:55.002282 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-85283e1b-3178-4570-bcaa-c0d1248fd792 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:55:55.007974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85283e1b-3178-4570-bcaa-c0d1248fd792 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:55.008460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85283e1b-3178-4570-bcaa-c0d1248fd792 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:55.008894 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85283e1b-3178-4570-bcaa-c0d1248fd792 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:55.031437 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-85283e1b-3178-4570-bcaa-c0d1248fd792 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Going to try to start instance {{(pid=126996) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 15:55:55.056188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:55:55.076409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-85283e1b-3178-4570-bcaa-c0d1248fd792 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/action" status: 202 len: 0 microversion: 2.1 time: 0.078025 Sep 28 15:55:55.077010 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 464/863] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:55:54 2022] POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:55:55.085963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:55.086624 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:55.092834 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:55.093325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:55.093768 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:55.094523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:55.094978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:55.095402 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:55.235668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:55.244518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dd635de5-6a50-47cd-809a-bfd634a53b6c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1708 microversion: 2.1 time: 0.162535 Sep 28 15:55:55.245387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 465/864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:55 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:56.269195 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:56.269798 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:56.276210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:56.276691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:56.277122 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:56.277816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:56.278268 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:56.278722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:56.411202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:56.419350 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-18942948-5d6c-4035-85d3-f48cad13c23a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1708 microversion: 2.1 time: 0.154652 Sep 28 15:55:56.419918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 466/865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:56 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:55:57.442703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:57.443412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:57.449845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:57.450314 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:57.450779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:57.451462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:57.451909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:57.452326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:57.581054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:55:57.589695 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5ccd90ca-e8e5-4150-b601-e1e86fb46376 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1712 microversion: 2.1 time: 0.150915 Sep 28 15:55:57.590283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 467/866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:55:57 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1712 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:56:52.948532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:52.949240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:52.951531 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=34 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:56:52.952184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:56:52.957902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:52.958385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:52.958844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:52.959534 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:52.959980 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:52.960400 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:53.041115 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lazy-loading 'services' on Instance uuid 9e69977b-2822-4e56-a25f-2683098b6ebb {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:56:53.111593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3cc1ee4c-8c89-4e27-b0f6-ebc14df358b9 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-volume_attachments/6fff1e39-dd26-41d5-9329-7cc45b2a70f1" status: 202 len: 0 microversion: 2.1 time: 0.166866 Sep 28 15:56:53.112262 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 468/867] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 15:56:52 2022] DELETE /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-volume_attachments/6fff1e39-dd26-41d5-9329-7cc45b2a70f1 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:56:55.298026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cc135e92-78ac-411c-8928-d48072664922 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:56:55.304176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc135e92-78ac-411c-8928-d48072664922 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:55.304656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc135e92-78ac-411c-8928-d48072664922 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:55.305089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cc135e92-78ac-411c-8928-d48072664922 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:55.326866 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cc135e92-78ac-411c-8928-d48072664922 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Going to try to stop instance {{(pid=126996) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 15:56:55.368445 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cc135e92-78ac-411c-8928-d48072664922 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/action" status: 202 len: 0 microversion: 2.1 time: 0.075160 Sep 28 15:56:55.369040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 469/868] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:56:55 2022] POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:56:55.377279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:55.377976 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:55.384258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:55.384744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:55.385176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:55.385973 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:55.386517 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:55.386944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:55.520135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:55.527836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e00d1b5f-2b61-47e1-a93b-fa5f187eaf6f tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.154572 Sep 28 15:56:55.528407 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 470/869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:55 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:56:56.551993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:56.552644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:56.559108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:56.559577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:56.560002 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:56.560672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:56.561114 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:56.561523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:56.687427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:56.695130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2c1a8276-3dcc-4681-b1df-3e3b9a747965 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.147790 Sep 28 15:56:56.695686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 471/870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:56 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:56:57.718457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:57.719162 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:57.725523 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:57.726006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:57.726467 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:57.727165 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:57.727611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:57.728029 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:57.864794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:57.873014 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c0effc8d-1d10-4633-b21a-30624d948e12 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.158355 Sep 28 15:56:57.873620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 472/871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:57 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:56:58.896265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:58.896928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:58.903227 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:58.903700 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:58.904127 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:58.904802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:58.905246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:58.905652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:59.039761 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:59.047501 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-47de837b-fbf0-4034-bdd3-2fb0aedfea9e tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.155764 Sep 28 15:56:59.048560 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 473/872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:58 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:57:00.071548 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:57:00.072238 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:57:00.078593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:00.079077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:00.079512 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:00.080202 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:00.080652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:00.081074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:00.207783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:57:00.215705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-deee2cc6-b640-48e9-a269-cdc7f95ae296 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.147981 Sep 28 15:57:00.216285 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 474/873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:57:00 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:57:01.240079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:57:01.240683 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:57:01.247291 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:01.247779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:01.248211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:01.248906 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:01.249357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:01.249802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:01.386469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:57:01.394283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e8e9c316-cc2d-4ed2-b08d-82d15b91aaf0 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.158011 Sep 28 15:57:01.394890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 475/874] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:57:01 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:57:02.417843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:57:02.418538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:57:02.424869 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:02.425346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:02.425781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:02.426493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:02.426945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:02.427362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:02.557152 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:57:02.565564 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c1c81941-564b-4f52-84e0-8ceb21808183 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.151657 Sep 28 15:57:02.566133 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 476/875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:57:02 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:57:03.588860 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:57:03.589507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:57:03.596549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:03.597024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:03.597446 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:03.598130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:03.598606 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:03.599021 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:03.732162 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:57:03.739904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-acb9e8b1-c155-46c9-a9ef-988ae9a30dac tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.154932 Sep 28 15:57:03.740477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 477/876] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:57:03 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:57:04.762833 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:57:04.763541 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:57:04.769851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:04.770325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:04.770782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:04.771469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:04.771908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:04.772322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:04.900462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:57:04.908698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5e5cac75-7a27-4bbb-a569-860f33a427fc tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1676 microversion: 2.1 time: 0.149705 Sep 28 15:57:04.909273 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 478/877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:57:04 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:57:05.931988 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:57:05.932668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:57:05.940711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:05.941205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:05.941702 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:05.942436 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:05.942898 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:05.943321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:06.075626 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:57:06.083222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dd6e4df3-2793-4a89-b917-ffcf244a0a19 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1653 microversion: 2.1 time: 0.155144 Sep 28 15:57:06.083784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 479/878] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:57:05 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:57:06.105197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d736289a-fbd9-40e9-baab-489cf9aca5e5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:57:06.111458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d736289a-fbd9-40e9-baab-489cf9aca5e5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:06.111936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d736289a-fbd9-40e9-baab-489cf9aca5e5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:06.112360 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d736289a-fbd9-40e9-baab-489cf9aca5e5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:06.134071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d736289a-fbd9-40e9-baab-489cf9aca5e5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Going to try to start instance {{(pid=126996) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 15:57:06.175062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d736289a-fbd9-40e9-baab-489cf9aca5e5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/action" status: 202 len: 0 microversion: 2.1 time: 0.073154 Sep 28 15:57:06.175669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 480/879] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 28 15:57:06 2022] POST /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:57:06.184452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:57:06.185067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:57:06.193506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:06.194000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:06.194950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:06.195775 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:06.196243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:06.197659 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:06.355562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:57:06.359122 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:57:06.365170 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5d5ceb8d-e9b5-414f-8a31-8624fbee298a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1662 microversion: 2.1 time: 0.185013 Sep 28 15:57:06.365755 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 481/880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:57:06 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:57:07.388430 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:57:07.389127 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:57:07.397252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:07.397711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:07.398138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:07.398869 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:57:07.399377 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:57:07.399791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:57:07.528223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:57:07.536521 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5cfdd114-d1e8-446e-b4ec-0973b975e655 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1666 microversion: 2.1 time: 0.152013 Sep 28 15:57:07.537095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 482/881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:57:07 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:03.816304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:03.818607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:03.821135 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:58:03.821270 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Wed Sep 28 15:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-volume_attachments (ip 10.222.0.60) !!! Sep 28 15:58:03.822481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:58:03.822592 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Wed Sep 28 15:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-volume_attachments (ip 10.222.0.60) !!! Sep 28 15:58:03.823583 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=30 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:58:03.824243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=6 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:58:03.834288 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:03.834804 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:03.835234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:03.835927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:03.836380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:03.836802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:03.866942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-be8c4963-6ba9-4d34-a337-2751b348509a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054987 Sep 28 15:58:03.867495 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 483/882] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:58:03 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 15:58:03.930503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:03.930992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:03.937165 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:03.937644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:03.938072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:03.939300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:03.939744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:03.940166 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:03.965671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:58:04.040062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-910f665a-2297-43d3-a344-552fe8ba0950 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 204 len: 0 microversion: 2.1 time: 0.112942 Sep 28 15:58:04.040718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 484/883] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:58:03 2022] DELETE /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 15:58:04.051080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:04.051782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:04.057559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:04.058043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:04.058502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:04.059192 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:04.059880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:04.060307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:04.289152 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:04.296897 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3674efe2-6735-4d62-9c6d-8a51f40e9167 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1672 microversion: 2.1 time: 0.251679 Sep 28 15:58:04.297393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 485/884] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:04 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1672 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:05.320722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:05.321310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:05.327863 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:05.328345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:05.328779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:05.329466 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:05.329914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:05.330359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:05.461013 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:05.468863 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-23b84899-a499-4b3d-8fc4-79280ec70cd3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1672 microversion: 2.1 time: 0.152056 Sep 28 15:58:05.469525 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 486/885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:05 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:06.493435 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:06.494132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:06.500309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:06.500792 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:06.501224 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:06.501925 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:06.502977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:06.503404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:06.721890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:06.729696 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ffa5af76-0dac-4d9f-8b59-5e4625a0719d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 200 len: 1672 microversion: 2.1 time: 0.240695 Sep 28 15:58:06.730272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 487/886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:06 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 1672 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:07.131228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-9b83d268-7e6b-4ea0-945d-cee29ae9c44d req-55ed0809-e56c-4f7c-9ccd-0a2bc4a9ef07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e69977b-2822-4e56-a25f-2683098b6ebb", "name": "network-vif-deleted", "tag": "3a57dfac-efe7-416f-8aee-5ccc5d541be3"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:58:07.142720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9b83d268-7e6b-4ea0-945d-cee29ae9c44d req-55ed0809-e56c-4f7c-9ccd-0a2bc4a9ef07 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:07.143682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9b83d268-7e6b-4ea0-945d-cee29ae9c44d req-55ed0809-e56c-4f7c-9ccd-0a2bc4a9ef07 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:07.144110 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9b83d268-7e6b-4ea0-945d-cee29ae9c44d req-55ed0809-e56c-4f7c-9ccd-0a2bc4a9ef07 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:07.157566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-9b83d268-7e6b-4ea0-945d-cee29ae9c44d req-55ed0809-e56c-4f7c-9ccd-0a2bc4a9ef07 service nova] Creating event network-vif-deleted:3a57dfac-efe7-416f-8aee-5ccc5d541be3 for instance 9e69977b-2822-4e56-a25f-2683098b6ebb on hv-cinder-85931 Sep 28 15:58:07.165075 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-9b83d268-7e6b-4ea0-945d-cee29ae9c44d req-55ed0809-e56c-4f7c-9ccd-0a2bc4a9ef07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038296 Sep 28 15:58:07.166367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 488/887] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:58:07.754974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:07.755757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:07.761966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:07.762568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:07.763862 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:07.764763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:07.765205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:07.765621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:07.783207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] HTTP exception thrown: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Request method failure captured: Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb HTTP/1.1 Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG4lF3dsAWWYqukm_17EoTStInMG2Cxl6rnPZ9IetWQbRq4i5mJE7seqk66m2-qpj-N321Kt1CU0lc2qz3Wq5nydCsvzjOsc_8RduVZwSGe82cmzpzcZhx60mJCTOnrkKC9MYORKB5mkHLDSMRTay_OmeTvTQHxh17Ex6zQKP26bCTA Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:58:07.784904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0891d5f021664ff6b39f555c63ee5e5e"}]}] Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: dae4ea8a6f5b4fc686bb07d31090ba3b Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:58:07.786392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '9e69977b-2822-4e56-a25f-2683098b6ebb'} Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:58:07.787442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:58:07.788751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:58:07.789940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Returning 404 to user: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:58:07.789940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-21561cd7-e93f-42f8-940d-9b3fad8b0e75 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 404 len: 111 microversion: 2.1 time: 0.036546 Sep 28 15:58:07.789940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 489/888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:07 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:58:07.796298 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-080c8594-bf61-4638-98fc-9803bf5cb5e7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '.version_select at 0x7f8fcfd640d0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:07.821783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-080c8594-bf61-4638-98fc-9803bf5cb5e7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530665565" status: 202 len: 0 microversion: 2.1 time: 0.030177 Sep 28 15:58:07.822591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 490/889] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 28 15:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530665565 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:58:08.479146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dd9f2bf7-1c06-4e15-83d0-fd95d2a58e9c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'create', calling method: .version_select at 0x7f8fcfc86d30>, body: {"keypair": {"name": "tempest-keypair-209779678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6+6CZlIhOM0O/xQge1oHDeDeZMKVC9CnYgpuEO55sPQyVnewvLhAY/+x8U4+5SzhPqzWJi2tArMKfYXl8vXciMlmOqglLTYeErHbOXsqUaaeYtGZiOfokgznwUchtpNw=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:58:08.496166 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-dd9f2bf7-1c06-4e15-83d0-fd95d2a58e9c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Getting quotas for project 0891d5f021664ff6b39f555c63ee5e5e. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:58:08.500059 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-dd9f2bf7-1c06-4e15-83d0-fd95d2a58e9c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Getting quotas for user dae4ea8a6f5b4fc686bb07d31090ba3b and project 0891d5f021664ff6b39f555c63ee5e5e. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:58:08.521887 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dd9f2bf7-1c06-4e15-83d0-fd95d2a58e9c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048856 Sep 28 15:58:08.522518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 491/890] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 15:58:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:58:09.791296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1429333411", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bef0f3be-4b54-4e83-80ee-c06d6d4e657b"}], "security_groups": [{"name": "tempest-securitygroup--143846909"}], "key_name": "tempest-keypair-209779678", "user_data": "}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:58:09.895862 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] validate_networks() for [('bef0f3be-4b54-4e83-80ee-c06d6d4e657b', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:58:10.312423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:58:10.312833 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:58:10.313294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:58:10.313688 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:58:10.314085 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:58:10.322583 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:10.323055 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:10.323479 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:10.324188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:10.324634 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:10.325044 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:10.341750 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Getting quotas for project 0891d5f021664ff6b39f555c63ee5e5e. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:58:10.345760 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Getting quotas for user dae4ea8a6f5b4fc686bb07d31090ba3b and project 0891d5f021664ff6b39f555c63ee5e5e. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:58:10.359366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:58:10.361763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:58:10.409688 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4638cd86-eeb4-4086-8f1b-be053d05b46a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.623749 Sep 28 15:58:10.410338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 492/891] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:58:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 15:58:10.421416 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bd608a1e-68c2-4092-b4b8-4d7dd0bf9e5d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:10.422050 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bd608a1e-68c2-4092-b4b8-4d7dd0bf9e5d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:10.485905 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-bd608a1e-68c2-4092-b4b8-4d7dd0bf9e5d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:10.492923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bd608a1e-68c2-4092-b4b8-4d7dd0bf9e5d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1237 microversion: 2.1 time: 0.075321 Sep 28 15:58:10.493488 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 493/892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:10 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:11.516880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:11.517549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:11.525121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:11.525610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:11.526043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:11.526811 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:11.527244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:11.527666 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:11.614647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:11.622553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e348f90a-9690-4d37-b0ca-e882e02427ea tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1307 microversion: 2.1 time: 0.110683 Sep 28 15:58:11.633329 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 494/893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:11 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:58:12.645222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:12.645917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:12.652779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:12.653490 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:12.653918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:12.654635 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:12.655079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:12.655493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:13.134598 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:13.142251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0b3665c8-3f46-49ca-bdcd-fdd35797a7df tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1362 microversion: 2.1 time: 0.500958 Sep 28 15:58:13.143606 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 495/894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:12 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1362 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:13.284122 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-b6911064-1f7b-4e40-bc68-bde23357425b req-f01c9a09-12a1-44df-92ea-29c4aef42e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c0e050-7deb-46db-b0e7-ca9846cef556", "tag": "93f8ff0b-0b53-4e89-9377-82ce8451e3df"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:58:13.294527 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b6911064-1f7b-4e40-bc68-bde23357425b req-f01c9a09-12a1-44df-92ea-29c4aef42e05 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:13.295155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b6911064-1f7b-4e40-bc68-bde23357425b req-f01c9a09-12a1-44df-92ea-29c4aef42e05 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:13.295656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b6911064-1f7b-4e40-bc68-bde23357425b req-f01c9a09-12a1-44df-92ea-29c4aef42e05 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:13.306766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-b6911064-1f7b-4e40-bc68-bde23357425b req-f01c9a09-12a1-44df-92ea-29c4aef42e05 service nova] Creating event network-changed:93f8ff0b-0b53-4e89-9377-82ce8451e3df for instance a8c0e050-7deb-46db-b0e7-ca9846cef556 on hv-cinder-85931 Sep 28 15:58:13.311769 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-b6911064-1f7b-4e40-bc68-bde23357425b req-f01c9a09-12a1-44df-92ea-29c4aef42e05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032103 Sep 28 15:58:13.312515 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 496/895] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:58:14.166368 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:14.167108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:14.173282 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:14.173760 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:14.174727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:14.175412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:14.175865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:14.176286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:14.308299 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:14.316365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d111fc01-12de-4030-acdf-c3b83f73b643 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1362 microversion: 2.1 time: 0.154844 Sep 28 15:58:14.316951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 497/896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:14 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:15.339067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:15.339695 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:15.346029 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:15.346550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:15.346984 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:15.347674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:15.348131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:15.348549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:15.475341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:15.483044 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-280e71f8-454c-48cd-aa08-902a57b2d25d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1362 microversion: 2.1 time: 0.147815 Sep 28 15:58:15.483606 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 498/897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:15 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:16.506664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:16.507316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:16.513705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:16.514127 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:16.514590 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:16.515275 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:16.515720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:16.516139 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:16.647140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:16.654859 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-42a28a20-14d8-48c0-9759-60eca284b21c tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1362 microversion: 2.1 time: 0.153170 Sep 28 15:58:16.655418 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 499/898] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:16 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:58:17.678476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:17.679095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:17.686054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:17.686598 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:17.687030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:17.687719 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:17.688162 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:17.688608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:17.822179 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:17.830051 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-79ccea12-22ce-40a4-81bd-edb8f14bc5d1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1362 microversion: 2.1 time: 0.155575 Sep 28 15:58:17.831387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 500/899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:17 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:58:17.916234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-2b6e22a9-c364-4290-85cd-81de29246484 req-4187fc4a-2b3a-44bb-9944-29d777295cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c0e050-7deb-46db-b0e7-ca9846cef556", "name": "network-vif-plugged", "status": "completed", "tag": "93f8ff0b-0b53-4e89-9377-82ce8451e3df"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:58:17.926096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2b6e22a9-c364-4290-85cd-81de29246484 req-4187fc4a-2b3a-44bb-9944-29d777295cbf service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:17.926733 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2b6e22a9-c364-4290-85cd-81de29246484 req-4187fc4a-2b3a-44bb-9944-29d777295cbf service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:17.927048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-2b6e22a9-c364-4290-85cd-81de29246484 req-4187fc4a-2b3a-44bb-9944-29d777295cbf service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:17.940824 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-2b6e22a9-c364-4290-85cd-81de29246484 req-4187fc4a-2b3a-44bb-9944-29d777295cbf service nova] Creating event network-vif-plugged:93f8ff0b-0b53-4e89-9377-82ce8451e3df for instance a8c0e050-7deb-46db-b0e7-ca9846cef556 on hv-cinder-85931 Sep 28 15:58:17.945791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-2b6e22a9-c364-4290-85cd-81de29246484 req-4187fc4a-2b3a-44bb-9944-29d777295cbf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Sep 28 15:58:17.946405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 501/900] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:58:18.856860 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:18.857483 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:18.864851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:18.865333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:18.865767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:18.866481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:18.866933 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:18.867354 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:19.001786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:19.009435 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d12cd2a5-0cf3-46bd-be10-b9f37479cea5 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1362 microversion: 2.1 time: 0.158373 Sep 28 15:58:19.010006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 502/901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:18 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:58:20.031948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:20.032572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:20.038954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:20.039435 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:20.039867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:20.040724 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:20.041235 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:20.041753 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:20.168539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:58:20.176729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f3276322-c9b2-4b6b-8b41-7eb8be3d6fa3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1547 microversion: 2.1 time: 0.148811 Sep 28 15:58:20.177286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 503/902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:58:20 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:58:20.199361 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:58:20.199848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:58:20.205650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:20.206126 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:20.206594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:20.207278 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:20.207723 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:20.208145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:20.211922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:58:20.285785 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-27a57e30-0788-41a7-b64a-b5b67f3fba84 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090018 Sep 28 15:58:20.286376 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 504/903] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 15:58:20 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:58:21.210959 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:58:21.211753 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=12 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:58:21.215998 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-8dead1b0-401e-49db-892c-372736d3bd90 req-099ef48b-1e24-412d-b31e-d597c4e1af6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c0e050-7deb-46db-b0e7-ca9846cef556", "tag": "93f8ff0b-0b53-4e89-9377-82ce8451e3df"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:58:21.226814 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8dead1b0-401e-49db-892c-372736d3bd90 req-099ef48b-1e24-412d-b31e-d597c4e1af6d service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:58:21.227380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8dead1b0-401e-49db-892c-372736d3bd90 req-099ef48b-1e24-412d-b31e-d597c4e1af6d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:58:21.227698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8dead1b0-401e-49db-892c-372736d3bd90 req-099ef48b-1e24-412d-b31e-d597c4e1af6d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:58:21.238903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-8dead1b0-401e-49db-892c-372736d3bd90 req-099ef48b-1e24-412d-b31e-d597c4e1af6d service nova] Creating event network-changed:93f8ff0b-0b53-4e89-9377-82ce8451e3df for instance a8c0e050-7deb-46db-b0e7-ca9846cef556 on hv-cinder-85931 Sep 28 15:58:21.243823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-8dead1b0-401e-49db-892c-372736d3bd90 req-099ef48b-1e24-412d-b31e-d597c4e1af6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033344 Sep 28 15:58:21.244621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 505/904] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:58:28.016976 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:58:28.017598 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 15:58:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 15:58:39.960068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:58:39.960739 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 15:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 15:58:39.961997 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:58:39.962146 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 15:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 15:59:25.806261 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:59:25.807120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:59:25.868153 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:25.868738 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:25.874887 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:25.875369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:25.875806 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:25.876497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:25.876947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:25.877404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:25.901403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4ffe9b6e-6ce9-4446-ad1c-432105e150ba tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/ips" status: 200 len: 145 microversion: 2.1 time: 0.097175 Sep 28 15:59:25.901952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 506/905] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 15:59:25 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/ips => generated 145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:27.231038 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a898260-c5f9-4395-9bc4-bf933693d445"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:59:27.233472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:27.239924 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:27.240896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:27.241328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:27.242011 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:27.242480 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:27.242903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:27.504993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0a2d9a0c-2448-4dd7-b97b-029f88aaaaf3 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277759 Sep 28 15:59:27.505600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 507/906] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 15:59:27 2022] POST /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:35.048289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:35.050584 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:35.057463 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:35.057939 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:35.058372 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:35.059103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:35.059553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:35.059978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:35.092953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a6b7d4d7-fd5b-42e2-beb2-3943450cbcc1 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049508 Sep 28 15:59:35.093514 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 508/907] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:59:35 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:35.104215 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:35.104695 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:35.110461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:35.110946 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:35.111375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:35.112062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:35.112511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:35.112929 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:35.141305 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-70caf99f-a38a-44ae-be1b-523f0a22dc58 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/3a898260-c5f9-4395-9bc4-bf933693d445" status: 200 len: 194 microversion: 2.1 time: 0.041196 Sep 28 15:59:35.141875 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 509/908] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 28 15:59:35 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/3a898260-c5f9-4395-9bc4-bf933693d445 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:36.474383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a8c1d94-d4fb-488d-a4a2-13b8186daeb1"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:59:36.477378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:36.483879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:36.484359 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:36.484795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:36.485484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:36.485932 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:36.486353 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:36.746443 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-18bd0629-0ffb-4ad5-abbe-adddfb54d476 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "POST /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275995 Sep 28 15:59:36.747304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 510/909] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 15:59:36 2022] POST /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:44.283273 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:44.285618 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:44.293417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:44.293888 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:44.294315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:44.295025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:44.295469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:44.295883 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:44.325943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bb98bed8-02fe-4945-ae18-447d8813440d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046903 Sep 28 15:59:44.326500 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 511/910] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:59:44 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:44.470743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:44.471145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:44.478151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:44.478647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:44.479068 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:44.479748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:44.480187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:44.480600 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:44.508567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6024fc2d-9ba6-4630-898e-51f4943e9196 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/3a898260-c5f9-4395-9bc4-bf933693d445" status: 200 len: 194 microversion: 2.1 time: 0.042031 Sep 28 15:59:44.509160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 512/911] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 28 15:59:44 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/3a898260-c5f9-4395-9bc4-bf933693d445 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:44.520250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:44.520740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:44.527148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:44.527626 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:44.528056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:44.528742 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:44.529222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:44.529643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:44.610061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lazy-loading 'services' on Instance uuid a8c0e050-7deb-46db-b0e7-ca9846cef556 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:59:44.680343 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c67ee81f-3ca1-4cdc-bc41-9e16b8bed70d tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/3a898260-c5f9-4395-9bc4-bf933693d445" status: 202 len: 0 microversion: 2.1 time: 0.164507 Sep 28 15:59:44.680929 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 513/912] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 15:59:44 2022] DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/3a898260-c5f9-4395-9bc4-bf933693d445 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:59:45.813928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:45.814603 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:45.820707 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:45.821186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:45.821616 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:45.822304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:45.822782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:45.823206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:45.852440 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9d9aba74-1d20-464e-b279-094dae9416d2 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/0a8c1d94-d4fb-488d-a4a2-13b8186daeb1" status: 200 len: 194 microversion: 2.1 time: 0.042955 Sep 28 15:59:45.853031 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 514/913] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 28 15:59:45 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/0a8c1d94-d4fb-488d-a4a2-13b8186daeb1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:45.863033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:45.863526 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:45.870039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:45.870551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:45.870983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:45.871667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:45.872119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:45.872540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:45.954544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lazy-loading 'services' on Instance uuid a8c0e050-7deb-46db-b0e7-ca9846cef556 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:59:46.024823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-00e4701d-c7ff-4ed2-b7a4-e5699c4c1d20 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/0a8c1d94-d4fb-488d-a4a2-13b8186daeb1" status: 202 len: 0 microversion: 2.1 time: 0.165240 Sep 28 15:59:46.025414 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 515/914] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 15:59:45 2022] DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments/0a8c1d94-d4fb-488d-a4a2-13b8186daeb1 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:59:47.203095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:47.205399 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:47.212156 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:47.212633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:47.213061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:47.213748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:47.214200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:47.214644 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:47.243630 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-adf12cd2-cc37-4042-a9c1-899da85e6883 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045400 Sep 28 15:59:47.244182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 516/915] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:59:47 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 15:59:47.359316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:47.361477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:47.367428 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:47.367903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:47.368331 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:47.369015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:47.369462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:47.369890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:47.399638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ee0e2d53-5054-4640-b01c-12aa3d6f27c8 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044140 Sep 28 15:59:47.400203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 517/916] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 15:59:47 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 15:59:47.464220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:47.464710 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:47.470566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:47.471044 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:47.471470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:47.472333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:47.472595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:47.473010 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:47.497833 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:59:47.500624 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:59:47.575540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-239e3f23-be33-455a-9235-c79acee20122 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 204 len: 0 microversion: 2.1 time: 0.114779 Sep 28 15:59:47.576356 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 518/917] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:59:47 2022] DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 15:59:47.584942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:47.585649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:47.592129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:47.592534 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:47.592973 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:47.593676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:47.594119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:47.594579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:47.731676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:59:47.739538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2f7a325b-5e52-423d-b418-f856af88fbb6 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1672 microversion: 2.1 time: 0.158949 Sep 28 15:59:47.740112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 519/918] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:59:47 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:59:48.763179 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:48.763857 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:48.770055 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:48.770577 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:48.770984 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:48.771666 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:48.772105 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:48.772517 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:48.905337 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:59:48.913230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-71a4a7f7-e130-4037-bd9b-328886f84233 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1672 microversion: 2.1 time: 0.153973 Sep 28 15:59:48.913800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 520/919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:59:48 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:59:49.936708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:49.937445 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:49.943951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:49.944508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:49.945007 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:49.946155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:49.946735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:49.947231 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:50.417003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae4ea8a6f5b4fc686bb07d31090ba3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0891d5f021664ff6b39f555c63ee5e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:59:50.424691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-56b131b2-da41-4e01-9361-dd4c0440b33a tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 200 len: 1672 microversion: 2.1 time: 0.492151 Sep 28 15:59:50.425503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 521/920] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:59:49 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 1672 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:59:50.879392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-1bb15ba7-601f-4039-befb-2db193a2f6cb req-dab06340-0e9a-45b3-8f97-2f262bd52176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c0e050-7deb-46db-b0e7-ca9846cef556", "name": "network-vif-deleted", "tag": "93f8ff0b-0b53-4e89-9377-82ce8451e3df"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:59:50.891363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-1bb15ba7-601f-4039-befb-2db193a2f6cb req-dab06340-0e9a-45b3-8f97-2f262bd52176 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:50.892148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-1bb15ba7-601f-4039-befb-2db193a2f6cb req-dab06340-0e9a-45b3-8f97-2f262bd52176 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:50.892615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-1bb15ba7-601f-4039-befb-2db193a2f6cb req-dab06340-0e9a-45b3-8f97-2f262bd52176 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:50.909128 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-1bb15ba7-601f-4039-befb-2db193a2f6cb req-dab06340-0e9a-45b3-8f97-2f262bd52176 service nova] Creating event network-vif-deleted:93f8ff0b-0b53-4e89-9377-82ce8451e3df for instance a8c0e050-7deb-46db-b0e7-ca9846cef556 on hv-cinder-85931 Sep 28 15:59:50.915980 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-1bb15ba7-601f-4039-befb-2db193a2f6cb req-dab06340-0e9a-45b3-8f97-2f262bd52176 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112565 Sep 28 15:59:50.916585 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 522/921] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 15:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:59:51.450291 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:51.451147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:51.457678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:51.458244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:51.458838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:51.460231 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:51.462550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:51.463099 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:51.478333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] HTTP exception thrown: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Request method failure captured: Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 HTTP/1.1 Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG4lF3dsAWWYqukm_17EoTStInMG2Cxl6rnPZ9IetWQbRq4i5mJE7seqk66m2-qpj-N321Kt1CU0lc2qz3Wq5nydCsvzjOsc_8RduVZwSGe82cmzpzcZhx60mJCTOnrkKC9MYORKB5mkHLDSMRTay_OmeTvTQHxh17Ex6zQKP26bCTA Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:59:51.480191 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0891d5f021664ff6b39f555c63ee5e5e"}]}] Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: dae4ea8a6f5b4fc686bb07d31090ba3b Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:51.482503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'a8c0e050-7deb-46db-b0e7-ca9846cef556'} Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:59:51.483615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:51.485197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:51.486694 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Returning 404 to user: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:59:51.486694 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-07f822f7-9e63-438e-935e-c5bf3f292a40 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 404 len: 111 microversion: 2.1 time: 0.036018 Sep 28 15:59:51.486694 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 523/922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:59:51 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:59:51.491726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-69244ddb-2147-4de7-ad7c-9d72ec56fe29 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '.version_select at 0x7f8fcfd02af0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:51.511826 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-69244ddb-2147-4de7-ad7c-9d72ec56fe29 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-209779678" status: 202 len: 0 microversion: 2.1 time: 0.024058 Sep 28 15:59:51.512315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 524/923] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 28 15:59:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-209779678 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:59:54.391124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:54.391689 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:54.401178 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:54.401668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:54.402106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:54.402838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:54.403287 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:54.403711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:54.417815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] HTTP exception thrown: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Request method failure captured: Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 HTTP/1.1 Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG4lF3dsAWWYqukm_17EoTStInMG2Cxl6rnPZ9IetWQbRq4i5mJE7seqk66m2-qpj-N321Kt1CU0lc2qz3Wq5nydCsvzjOsc_8RduVZwSGe82cmzpzcZhx60mJCTOnrkKC9MYORKB5mkHLDSMRTay_OmeTvTQHxh17Ex6zQKP26bCTA Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:59:54.419391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0891d5f021664ff6b39f555c63ee5e5e"}]}] Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: dae4ea8a6f5b4fc686bb07d31090ba3b Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.421040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'a8c0e050-7deb-46db-b0e7-ca9846cef556'} Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:59:54.421953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.423465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.425228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Returning 404 to user: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:59:54.425228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2f48e77a-7497-43e4-a33a-0ec9a67d39fb tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 404 len: 111 microversion: 2.1 time: 0.034254 Sep 28 15:59:54.425228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 525/924] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:59:54 2022] DELETE /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:59:54.428675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:54.429275 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: a8c0e050-7deb-46db-b0e7-ca9846cef556] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:54.435065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:54.435548 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:54.435983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:54.436929 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:54.437378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:54.437796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:54.450785 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] HTTP exception thrown: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Request method failure captured: Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 HTTP/1.1 Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG4lF3dsAWWYqukm_17EoTStInMG2Cxl6rnPZ9IetWQbRq4i5mJE7seqk66m2-qpj-N321Kt1CU0lc2qz3Wq5nydCsvzjOsc_8RduVZwSGe82cmzpzcZhx60mJCTOnrkKC9MYORKB5mkHLDSMRTay_OmeTvTQHxh17Ex6zQKP26bCTA Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:59:54.452279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0891d5f021664ff6b39f555c63ee5e5e"}]}] Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: dae4ea8a6f5b4fc686bb07d31090ba3b Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.453819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'a8c0e050-7deb-46db-b0e7-ca9846cef556'} Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:59:54.454711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. Sep 28 15:59:54.456176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:54.457544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Returning 404 to user: Instance a8c0e050-7deb-46db-b0e7-ca9846cef556 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:59:54.457544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d6aa473c-db76-4610-b8db-068efe70d48b tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556" status: 404 len: 111 microversion: 2.1 time: 0.028482 Sep 28 15:59:54.457544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 526/925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:59:54 2022] GET /compute/v2.1/servers/a8c0e050-7deb-46db-b0e7-ca9846cef556 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:59:55.601310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:55.602469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:55.608775 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:55.609249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:55.609676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:55.610362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:55.610864 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:55.611341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:55.626382 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] HTTP exception thrown: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Request method failure captured: Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb HTTP/1.1 Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG4lF3dsAWWYqukm_17EoTStInMG2Cxl6rnPZ9IetWQbRq4i5mJE7seqk66m2-qpj-N321Kt1CU0lc2qz3Wq5nydCsvzjOsc_8RduVZwSGe82cmzpzcZhx60mJCTOnrkKC9MYORKB5mkHLDSMRTay_OmeTvTQHxh17Ex6zQKP26bCTA Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:59:55.627955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0891d5f021664ff6b39f555c63ee5e5e"}]}] Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: dae4ea8a6f5b4fc686bb07d31090ba3b Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.629643 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '9e69977b-2822-4e56-a25f-2683098b6ebb'} Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:59:55.630581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.632212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.634024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Returning 404 to user: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:59:55.634024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-096a94cf-117f-4e0a-a180-2e4fd6ce9888 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 404 len: 111 microversion: 2.1 time: 0.031888 Sep 28 15:59:55.634024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 527/926] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 15:59:55 2022] DELETE /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:59:55.638097 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:59:55.638734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] [instance: 9e69977b-2822-4e56-a25f-2683098b6ebb] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:59:55.648065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:55.649048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:55.649477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:55.650165 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:59:55.650633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:59:55.651046 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:59:55.666331 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] HTTP exception thrown: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Request method failure captured: Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb HTTP/1.1 Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG4lF3dsAWWYqukm_17EoTStInMG2Cxl6rnPZ9IetWQbRq4i5mJE7seqk66m2-qpj-N321Kt1CU0lc2qz3Wq5nydCsvzjOsc_8RduVZwSGe82cmzpzcZhx60mJCTOnrkKC9MYORKB5mkHLDSMRTay_OmeTvTQHxh17Ex6zQKP26bCTA Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 15:59:55.667873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0891d5f021664ff6b39f555c63ee5e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0891d5f021664ff6b39f555c63ee5e5e"}]}] Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 0891d5f021664ff6b39f555c63ee5e5e Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1772153181 Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: dae4ea8a6f5b4fc686bb07d31090ba3b Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeTestJSON-1772153181-project Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.669474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '9e69977b-2822-4e56-a25f-2683098b6ebb'} Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:59:55.670574 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. Sep 28 15:59:55.672142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 15:59:55.673465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] Returning 404 to user: Instance 9e69977b-2822-4e56-a25f-2683098b6ebb could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:59:55.673465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5a0a33bd-50d8-4b11-abda-7e3c57bf6cd7 tempest-AttachVolumeTestJSON-1772153181 tempest-AttachVolumeTestJSON-1772153181-project] 10.222.0.60 "GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb" status: 404 len: 111 microversion: 2.1 time: 0.034718 Sep 28 15:59:55.673465 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 528/927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 15:59:55 2022] GET /compute/v2.1/servers/9e69977b-2822-4e56-a25f-2683098b6ebb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 16:00:04.180601 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-58b06315-fa9e-43eb-8b92-3ef6444deda9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: .version_select at 0x7f8fcfc86670>, body: {"keypair": {"name": "tempest-keypair-972795262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtTfL2JQCvEjsFN/tS9Cex4oPpQgD//F4GQ1iXHnUPb8wp+W8mI6lJl5CFiooRhl5f3fMY9rz5Elf4liuouznaSgUfW4I8qB/v+xy2cdYmSo/R12WVZlqIhgoQcuL9NIw=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:00:04.186155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:00:04.200575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-58b06315-fa9e-43eb-8b92-3ef6444deda9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for project 9cf83fa74c6648ba959db6679857c466. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:00:04.205937 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-58b06315-fa9e-43eb-8b92-3ef6444deda9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for user ef337fd87e3a46c68339951fc72a281b and project 9cf83fa74c6648ba959db6679857c466. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:00:04.231721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-58b06315-fa9e-43eb-8b92-3ef6444deda9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171237 Sep 28 16:00:04.232746 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 529/928] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 16:00:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:00:05.578957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1950910893", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8ee297b-b45a-42fe-98ce-2cb512c2c741"}], "security_groups": [{"name": "tempest-securitygroup--1800723413"}], "key_name": "tempest-keypair-972795262", "user_data": "}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:00:05.656231 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:00:05.691631 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] validate_networks() for [('d8ee297b-b45a-42fe-98ce-2cb512c2c741', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 16:00:06.081575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 16:00:06.082003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 16:00:06.082502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 16:00:06.082913 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 16:00:06.083325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 16:00:06.093508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:06.093990 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:06.094436 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:06.095184 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:06.095633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:06.096117 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:06.114108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for project 9cf83fa74c6648ba959db6679857c466. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:00:06.118858 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for user ef337fd87e3a46c68339951fc72a281b and project 9cf83fa74c6648ba959db6679857c466. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:00:06.130077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 16:00:06.132442 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 16:00:06.182285 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-280472fa-c726-442f-b3b2-f6fabc64c310 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608388 Sep 28 16:00:06.183141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 530/929] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 16:00:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 16:00:06.194715 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-60b5c4a1-75d0-41da-a92f-10fab8185a1e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:06.195894 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-60b5c4a1-75d0-41da-a92f-10fab8185a1e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:06.256647 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-60b5c4a1-75d0-41da-a92f-10fab8185a1e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:06.269984 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-60b5c4a1-75d0-41da-a92f-10fab8185a1e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1241 microversion: 2.1 time: 0.079127 Sep 28 16:00:06.270889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 531/930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:06 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:07.292849 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:07.293471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:07.304105 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:07.307004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:07.307753 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:07.308699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:07.312762 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:07.313438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:07.430919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:07.443862 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9f2d2427-d31d-45aa-9c93-951295315332 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1293 microversion: 2.1 time: 0.154803 Sep 28 16:00:07.452259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 532/931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:07 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:08.472131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:08.473107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:08.480178 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:08.480691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:08.481120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:08.481813 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:08.482255 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:08.482736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:08.671953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:08.680277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-290af13f-57cf-4635-99d4-33346eeba015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1367 microversion: 2.1 time: 0.212204 Sep 28 16:00:08.680879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 533/932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:08 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:09.046917 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-0c2b8389-3445-48b3-aa2a-7d8a6f831ef9 req-38d0ea54-4f06-409d-8a66-86c985b2c940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dca5965-cf72-45f0-ae5c-db8e8fd01cd2", "tag": "e0993302-f321-4848-b011-5ee2bbebc2fc"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:00:09.057551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0c2b8389-3445-48b3-aa2a-7d8a6f831ef9 req-38d0ea54-4f06-409d-8a66-86c985b2c940 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:09.058030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0c2b8389-3445-48b3-aa2a-7d8a6f831ef9 req-38d0ea54-4f06-409d-8a66-86c985b2c940 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:09.058664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0c2b8389-3445-48b3-aa2a-7d8a6f831ef9 req-38d0ea54-4f06-409d-8a66-86c985b2c940 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:09.071680 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-0c2b8389-3445-48b3-aa2a-7d8a6f831ef9 req-38d0ea54-4f06-409d-8a66-86c985b2c940 service nova] Creating event network-changed:e0993302-f321-4848-b011-5ee2bbebc2fc for instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 on hv-cinder-85931 Sep 28 16:00:09.076613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-0c2b8389-3445-48b3-aa2a-7d8a6f831ef9 req-38d0ea54-4f06-409d-8a66-86c985b2c940 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038747 Sep 28 16:00:09.077297 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 534/933] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:00:09.704559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:09.705290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:09.712290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:09.712773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:09.713213 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:09.713918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:09.714361 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:09.714805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:09.843667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:09.852228 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4148a123-e5b0-42d4-a118-62abdacae01e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1367 microversion: 2.1 time: 0.152481 Sep 28 16:00:09.852794 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 535/934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:09 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:10.874552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:10.875309 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:10.881622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:10.882096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:10.882552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:10.883251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:10.883689 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:10.884101 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:11.020201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:11.029437 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bcdd5141-564f-4209-8d6d-98388729d085 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1367 microversion: 2.1 time: 0.158761 Sep 28 16:00:11.030026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 536/935] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:10 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:12.051591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:12.052248 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:12.059289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:12.059775 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:12.060199 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:12.060893 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:12.061596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:12.062012 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:12.191548 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:12.199201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-de0efb8c-1073-4deb-b7f7-0485bd2d78b0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1367 microversion: 2.1 time: 0.151559 Sep 28 16:00:12.199774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 537/936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:12 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:13.222185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:13.222942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:13.229368 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:13.229844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:13.230278 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:13.230991 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:13.231436 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:13.231853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:13.376591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:13.384232 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b45dbbbb-a13d-4bcc-9415-918497ee109f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1367 microversion: 2.1 time: 0.165957 Sep 28 16:00:13.384805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 538/937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:13 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:14.406692 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:14.407325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:14.413749 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:14.414231 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:14.414691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:14.415383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:14.415833 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:14.416252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:14.549475 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:14.557922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-93a5ec46-e074-4d6d-a086-4c294ddf5089 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1367 microversion: 2.1 time: 0.155119 Sep 28 16:00:14.558520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 539/938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:14 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:14.761226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-b7a15b6c-55d7-4508-a5b1-12db4dae89c2 req-8ec66e98-c059-438f-9994-6e4e8c779e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dca5965-cf72-45f0-ae5c-db8e8fd01cd2", "name": "network-vif-plugged", "status": "completed", "tag": "e0993302-f321-4848-b011-5ee2bbebc2fc"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:00:14.771607 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b7a15b6c-55d7-4508-a5b1-12db4dae89c2 req-8ec66e98-c059-438f-9994-6e4e8c779e5d service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:14.772084 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b7a15b6c-55d7-4508-a5b1-12db4dae89c2 req-8ec66e98-c059-438f-9994-6e4e8c779e5d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:14.772508 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b7a15b6c-55d7-4508-a5b1-12db4dae89c2 req-8ec66e98-c059-438f-9994-6e4e8c779e5d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:14.783370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-b7a15b6c-55d7-4508-a5b1-12db4dae89c2 req-8ec66e98-c059-438f-9994-6e4e8c779e5d service nova] Creating event network-vif-plugged:e0993302-f321-4848-b011-5ee2bbebc2fc for instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 on hv-cinder-85931 Sep 28 16:00:14.788244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-b7a15b6c-55d7-4508-a5b1-12db4dae89c2 req-8ec66e98-c059-438f-9994-6e4e8c779e5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086787 Sep 28 16:00:14.789342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 540/939] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:00:15.582639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:15.583277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:15.589962 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:15.590470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:15.590904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:15.591591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:15.592040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:15.592466 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:15.722250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:15.730007 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e32131c8-1b7f-41a4-b4a0-589af49e654f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1367 microversion: 2.1 time: 0.152291 Sep 28 16:00:15.730595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 541/940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:15 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:16.752614 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:16.753283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:16.755195 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:00:16.755905 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=12 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:00:16.762875 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:16.763350 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:16.763774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:16.764457 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:16.764895 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:16.765312 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:16.896681 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:00:16.904447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-941b59af-10e9-4452-882e-d65e9b7fe3df tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1557 microversion: 2.1 time: 0.155665 Sep 28 16:00:16.905016 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 542/941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:00:16 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:00:16.925891 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:00:16.926310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:00:16.932657 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:16.933139 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:16.933575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:16.934336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:16.934747 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:16.935179 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:17.013084 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-11cbc615-6a9a-47c4-989d-47748fb007f4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090727 Sep 28 16:00:17.013688 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 543/942] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 16:00:16 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:00:18.186765 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-3dcbd3f2-170e-473e-b99f-80f9f381cee0 req-c0c02ed4-9801-4b5b-be2b-3fed214d1fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dca5965-cf72-45f0-ae5c-db8e8fd01cd2", "tag": "e0993302-f321-4848-b011-5ee2bbebc2fc"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:00:18.196215 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3dcbd3f2-170e-473e-b99f-80f9f381cee0 req-c0c02ed4-9801-4b5b-be2b-3fed214d1fca service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:00:18.196682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3dcbd3f2-170e-473e-b99f-80f9f381cee0 req-c0c02ed4-9801-4b5b-be2b-3fed214d1fca service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:00:18.197107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3dcbd3f2-170e-473e-b99f-80f9f381cee0 req-c0c02ed4-9801-4b5b-be2b-3fed214d1fca service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:00:18.208528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-3dcbd3f2-170e-473e-b99f-80f9f381cee0 req-c0c02ed4-9801-4b5b-be2b-3fed214d1fca service nova] Creating event network-changed:e0993302-f321-4848-b011-5ee2bbebc2fc for instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 on hv-cinder-85931 Sep 28 16:00:18.213948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-3dcbd3f2-170e-473e-b99f-80f9f381cee0 req-c0c02ed4-9801-4b5b-be2b-3fed214d1fca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031597 Sep 28 16:00:18.214610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 544/943] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:01:22.768639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:01:22.769443 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=66 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:01:22.774754 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:22.775341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:22.783121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:22.783605 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:22.784034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:22.784730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:22.785181 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:22.785605 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:22.809090 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-84f54b9d-c05b-4b7b-8642-ac48f7cfc5c9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/ips" status: 200 len: 150 microversion: 2.1 time: 0.042824 Sep 28 16:01:22.809668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 545/944] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 16:01:22 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:01:24.176444 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ba749ef-3f3d-4465-a108-e472c26d7a64"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:01:24.178780 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:24.185624 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:24.186101 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:24.186567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:24.187507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:24.187961 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:24.188380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:24.447604 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-50af755d-02d3-49c6-9a3d-e8e77fb1aa2c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274847 Sep 28 16:01:24.448216 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 546/945] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 16:01:24 2022] POST /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:01:31.994370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f3d03a20-5d69-4b33-975b-0aa90694155f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: .version_select at 0x7f8fcf97c310>, body: {"keypair": {"name": "tempest-keypair-1479984502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpgWaRQH7AU2u4rBTVC/1t9mYeIftfqX5WuqY9nqK4TPeXiC4hrSbhDmVMeThFCEW9tyuRGw14ldqHWsKxxFlBjc8qEMvHuFbM3c3ZKITrNXopqGp9ffHK0064YVQOwAg=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:01:32.010519 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-f3d03a20-5d69-4b33-975b-0aa90694155f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for project 9cf83fa74c6648ba959db6679857c466. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:01:32.014303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-f3d03a20-5d69-4b33-975b-0aa90694155f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for user ef337fd87e3a46c68339951fc72a281b and project 9cf83fa74c6648ba959db6679857c466. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:01:32.038084 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f3d03a20-5d69-4b33-975b-0aa90694155f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048350 Sep 28 16:01:32.038726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 547/946] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 16:01:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:01:33.268220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-251336617", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8ee297b-b45a-42fe-98ce-2cb512c2c741"}], "security_groups": [{"name": "tempest-securitygroup--324538326"}], "key_name": "tempest-keypair-1479984502", "user_data": "}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:01:33.371276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] validate_networks() for [('d8ee297b-b45a-42fe-98ce-2cb512c2c741', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 16:01:33.740652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 16:01:33.741072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 16:01:33.741543 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 16:01:33.741948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 16:01:33.742397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 16:01:33.751267 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:33.751745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:33.752176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:33.752902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:33.753351 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:33.753772 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:33.771469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for project 9cf83fa74c6648ba959db6679857c466. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:01:33.776089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for user ef337fd87e3a46c68339951fc72a281b and project 9cf83fa74c6648ba959db6679857c466. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:01:33.787276 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 16:01:33.789735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 16:01:33.838091 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ede44856-8611-4cc2-a542-9a57a0b41c13 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.574735 Sep 28 16:01:33.838787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 548/947] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 16:01:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 16:01:33.849873 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-71986d07-3fba-4242-838e-9f5e4cc41800 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:33.850516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-71986d07-3fba-4242-838e-9f5e4cc41800 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:33.908186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-71986d07-3fba-4242-838e-9f5e4cc41800 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:33.915092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-71986d07-3fba-4242-838e-9f5e4cc41800 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1241 microversion: 2.1 time: 0.069085 Sep 28 16:01:33.915668 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 549/948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:33 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:34.937757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:34.939343 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:34.948593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:34.948593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:34.948593 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:34.949447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:34.950044 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:34.950546 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:35.029026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:35.038336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2e49b3c6-9938-423a-8293-bdf09aa157d9 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1301 microversion: 2.1 time: 0.104930 Sep 28 16:01:35.040822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 550/949] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:34 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:36.062538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:36.063182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:36.069471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:36.069955 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:36.070384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:36.071102 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:36.071552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:36.071969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:36.296219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:36.304165 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3639888a-105d-4701-96c8-098eac82fda0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1366 microversion: 2.1 time: 0.246476 Sep 28 16:01:36.304743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 551/950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:36 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:36.480632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-0a537ad8-62f0-4a91-b451-c094fa6d2b75 req-9c0bcbaa-0b14-429b-98b2-f33ddc3275a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3aecaca-d1ba-47b4-987e-06a127be3d8c", "tag": "18059041-1477-4deb-8a24-f3946162ccb1"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:01:36.494921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0a537ad8-62f0-4a91-b451-c094fa6d2b75 req-9c0bcbaa-0b14-429b-98b2-f33ddc3275a7 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:36.495802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0a537ad8-62f0-4a91-b451-c094fa6d2b75 req-9c0bcbaa-0b14-429b-98b2-f33ddc3275a7 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:36.496506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0a537ad8-62f0-4a91-b451-c094fa6d2b75 req-9c0bcbaa-0b14-429b-98b2-f33ddc3275a7 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:36.510077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-0a537ad8-62f0-4a91-b451-c094fa6d2b75 req-9c0bcbaa-0b14-429b-98b2-f33ddc3275a7 service nova] Creating event network-changed:18059041-1477-4deb-8a24-f3946162ccb1 for instance c3aecaca-d1ba-47b4-987e-06a127be3d8c on hv-cinder-85931 Sep 28 16:01:36.516371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-0a537ad8-62f0-4a91-b451-c094fa6d2b75 req-9c0bcbaa-0b14-429b-98b2-f33ddc3275a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039660 Sep 28 16:01:36.517661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 552/951] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:01:37.328462 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:37.329111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:37.335502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:37.335971 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:37.336394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:37.337067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:37.337506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:37.337928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:37.475160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:37.483283 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-99c16fbf-a728-4ea1-8fce-0c6d417f9023 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1366 microversion: 2.1 time: 0.159523 Sep 28 16:01:37.483851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 553/952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:37 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:38.505848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:38.506568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:38.513944 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:38.514432 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:38.514927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:38.515564 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:38.516039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:38.516475 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:38.643706 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:38.651751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-40545b21-d33c-46d3-aa1b-99fb255f1e2f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1366 microversion: 2.1 time: 0.149769 Sep 28 16:01:38.652316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 554/953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:38 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:39.675103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:39.676518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:39.685303 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:39.685786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:39.686210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:39.687000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:39.687977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:39.688701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:39.820116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:39.828499 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e5286f6c-f71b-41df-894c-5e46d854def3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1366 microversion: 2.1 time: 0.157743 Sep 28 16:01:39.829094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 555/954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:39 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:40.851143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:40.851805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:40.858915 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:40.859396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:40.859832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:40.860517 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:40.860969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:40.861383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:40.990773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:40.998511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8e57573e-ea67-4ce9-af6a-b5270426daf3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1366 microversion: 2.1 time: 0.151274 Sep 28 16:01:40.999089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 556/955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:40 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:41.127322 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-780153b6-2a86-4fbb-9724-460db57a4c89 req-c9a69482-32bf-4794-9da9-baf25d7108ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3aecaca-d1ba-47b4-987e-06a127be3d8c", "name": "network-vif-plugged", "status": "completed", "tag": "18059041-1477-4deb-8a24-f3946162ccb1"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:01:41.137208 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-780153b6-2a86-4fbb-9724-460db57a4c89 req-c9a69482-32bf-4794-9da9-baf25d7108ad service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:41.137824 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-780153b6-2a86-4fbb-9724-460db57a4c89 req-c9a69482-32bf-4794-9da9-baf25d7108ad service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:41.138134 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-780153b6-2a86-4fbb-9724-460db57a4c89 req-c9a69482-32bf-4794-9da9-baf25d7108ad service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:41.149364 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-780153b6-2a86-4fbb-9724-460db57a4c89 req-c9a69482-32bf-4794-9da9-baf25d7108ad service nova] Creating event network-vif-plugged:18059041-1477-4deb-8a24-f3946162ccb1 for instance c3aecaca-d1ba-47b4-987e-06a127be3d8c on hv-cinder-85931 Sep 28 16:01:41.154806 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-780153b6-2a86-4fbb-9724-460db57a4c89 req-c9a69482-32bf-4794-9da9-baf25d7108ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031231 Sep 28 16:01:41.155497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 557/956] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:01:42.022175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:42.022891 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:42.029467 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:42.029937 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:42.030358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:42.031055 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:42.031495 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:42.031905 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:42.166112 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:42.173830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c5cadea3-8d65-416a-809d-b0617b4985a0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1366 microversion: 2.1 time: 0.156316 Sep 28 16:01:42.174391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 558/957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:42 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:43.196559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:43.197270 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:43.203587 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:43.204063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:43.204489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:43.205171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:43.205614 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:43.206029 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:43.334850 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:01:43.342757 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-03f33a45-02df-4565-bf33-f38fff3bb3fd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1556 microversion: 2.1 time: 0.150137 Sep 28 16:01:43.343349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 559/958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:01:43 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:01:43.368264 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:01:43.369379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:01:43.375393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:43.375894 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:43.376323 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:43.377006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:43.377448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:43.377870 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:43.456811 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8da3ce55-bde9-44a8-98dc-9276f25ccab0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092340 Sep 28 16:01:43.457405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 560/959] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 16:01:43 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:01:44.397951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:01:44.398809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=12 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:01:44.403655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-6e208df6-7665-4c92-b5bf-5c362b4284f3 req-f9b5209c-f21d-4b56-9770-6f1a997cf7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3aecaca-d1ba-47b4-987e-06a127be3d8c", "tag": "18059041-1477-4deb-8a24-f3946162ccb1"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:01:44.413793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6e208df6-7665-4c92-b5bf-5c362b4284f3 req-f9b5209c-f21d-4b56-9770-6f1a997cf7a2 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:01:44.414259 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6e208df6-7665-4c92-b5bf-5c362b4284f3 req-f9b5209c-f21d-4b56-9770-6f1a997cf7a2 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:01:44.414715 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6e208df6-7665-4c92-b5bf-5c362b4284f3 req-f9b5209c-f21d-4b56-9770-6f1a997cf7a2 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:01:44.426563 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-6e208df6-7665-4c92-b5bf-5c362b4284f3 req-f9b5209c-f21d-4b56-9770-6f1a997cf7a2 service nova] Creating event network-changed:18059041-1477-4deb-8a24-f3946162ccb1 for instance c3aecaca-d1ba-47b4-987e-06a127be3d8c on hv-cinder-85931 Sep 28 16:01:44.431489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-6e208df6-7665-4c92-b5bf-5c362b4284f3 req-f9b5209c-f21d-4b56-9770-6f1a997cf7a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034092 Sep 28 16:01:44.432076 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 561/960] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:01:48.027408 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 16:01:48.028038 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 16:01:59.973844 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 16:01:59.974692 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:01:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 16:01:59.975549 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 16:01:59.975664 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:01:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 16:02:49.080387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:02:49.081229 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:02:49.086241 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:49.086861 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:49.094791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:49.095277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:49.095707 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:49.096404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:49.096848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:49.097266 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:49.127053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a910d412-fcab-403b-8d44-06110caa4341 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c/ips" status: 200 len: 149 microversion: 2.1 time: 0.048887 Sep 28 16:02:49.127663 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 562/961] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 16:02:49 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:02:49.138996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ba749ef-3f3d-4465-a108-e472c26d7a64"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:02:49.141381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:49.147518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:49.147981 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:49.148409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:49.149093 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:49.149536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:49.149956 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:49.230656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Invalid volume: volume 7ba749ef-3f3d-4465-a108-e472c26d7a64 is already attached to instances: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: POST /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c/os-volume_attachments HTTP/1.1 Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 74 Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:02:49.232648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {"volumeAttachment": {"volumeId": "7ba749ef-3f3d-4465-a108-e472c26d7a64"}} Sep 28 16:02:49.234336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Invalid volume: volume 7ba749ef-3f3d-4465-a108-e472c26d7a64 is already attached to instances: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'server_id': 'c3aecaca-d1ba-47b4-987e-06a127be3d8c', 'body': {'volumeAttachment': {'volumeId': '7ba749ef-3f3d-4465-a108-e472c26d7a64'}}} Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ba749ef-3f3d-4465-a108-e472c26d7a64 is already attached to instances: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:49.235370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ba749ef-3f3d-4465-a108-e472c26d7a64 is already attached to instances: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:49.236940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:02:49.238848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:02:49.238848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:02:49.238848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:02:49.238848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ba749ef-3f3d-4465-a108-e472c26d7a64 is already attached to instances: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 Sep 28 16:02:49.238848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:49.238848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 400 to user: Invalid volume: volume 7ba749ef-3f3d-4465-a108-e472c26d7a64 is already attached to instances: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:02:49.238848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-73bec79f-d6ed-4580-a072-bbbfb7fac9c6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098844 Sep 28 16:02:49.238848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 563/962] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 16:02:49 2022] POST /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 28 16:02:49.242444 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:49.242936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:49.250207 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:49.250723 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:49.251155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:49.251839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:49.252280 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:49.252696 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:49.277559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 16:02:49.351935 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c1158770-dec4-47c1-a769-7038f0bd1565 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 204 len: 0 microversion: 2.1 time: 0.112563 Sep 28 16:02:49.352553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 564/963] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:02:49 2022] DELETE /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 16:02:49.363211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:49.363913 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:49.370137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:49.371193 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:49.371622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:49.372316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:49.372768 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:49.373186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:49.506711 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:02:49.514400 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2adc1980-e3fd-407c-82c6-c9b92ea4911f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1680 microversion: 2.1 time: 0.155260 Sep 28 16:02:49.514971 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 565/964] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:02:49 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:02:50.537104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:50.537732 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:50.544027 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:50.544502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:50.544924 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:50.545596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:50.546058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:50.546494 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:50.676522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:02:50.684971 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-84614757-bf37-4431-a73f-1574b0dbde69 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1680 microversion: 2.1 time: 0.151740 Sep 28 16:02:50.685538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 566/965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:02:50 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:02:51.709083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:51.709763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:51.716057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:51.716542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:51.716974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:51.717665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:51.718121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:51.718569 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:51.804594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:02:51.813532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-505f24db-6b65-49c7-bc1c-b83be23f81c8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 200 len: 1613 microversion: 2.1 time: 0.108234 Sep 28 16:02:51.814108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 567/966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:02:51 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 1613 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:02:52.065501 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-337e8381-fa02-404e-bc62-5ed64fc75688 req-6113af2b-0a58-4816-97c0-a1efe2e1fec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3aecaca-d1ba-47b4-987e-06a127be3d8c", "name": "network-vif-deleted", "tag": "18059041-1477-4deb-8a24-f3946162ccb1"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:02:52.078999 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-337e8381-fa02-404e-bc62-5ed64fc75688 req-6113af2b-0a58-4816-97c0-a1efe2e1fec1 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:52.079470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-337e8381-fa02-404e-bc62-5ed64fc75688 req-6113af2b-0a58-4816-97c0-a1efe2e1fec1 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:52.079894 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-337e8381-fa02-404e-bc62-5ed64fc75688 req-6113af2b-0a58-4816-97c0-a1efe2e1fec1 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:52.092257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-337e8381-fa02-404e-bc62-5ed64fc75688 req-6113af2b-0a58-4816-97c0-a1efe2e1fec1 service nova] Creating event network-vif-deleted:18059041-1477-4deb-8a24-f3946162ccb1 for instance c3aecaca-d1ba-47b4-987e-06a127be3d8c on hv-cinder-85931 Sep 28 16:02:52.101209 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-337e8381-fa02-404e-bc62-5ed64fc75688 req-6113af2b-0a58-4816-97c0-a1efe2e1fec1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040397 Sep 28 16:02:52.102280 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 568/967] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:02:52.838005 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:52.838775 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:52.845412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:52.845899 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:52.846334 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:52.847058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:52.847512 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:52.847932 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:52.861409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c HTTP/1.1 Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:02:52.862978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:02:52.864743 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'c3aecaca-d1ba-47b4-987e-06a127be3d8c'} Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:02:52.865571 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:02:52.866967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:52.868148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:02:52.868148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c1db1917-ab4b-465e-a2c1-693bc2145d23 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 404 len: 111 microversion: 2.1 time: 0.030757 Sep 28 16:02:52.868148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 569/968] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:02:52 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:02:52.872968 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e0511472-5038-444f-9cfd-9f92bc0298fc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '.version_select at 0x7f8fcfb28160>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:52.893403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e0511472-5038-444f-9cfd-9f92bc0298fc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479984502" status: 202 len: 0 microversion: 2.1 time: 0.023997 Sep 28 16:02:52.893981 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 570/969] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 28 16:02:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479984502 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 16:02:53.796477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:53.796963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:53.803546 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:53.804022 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:53.806365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:53.806365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:53.806365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:53.806365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:53.885879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lazy-loading 'services' on Instance uuid 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 16:02:53.956809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c5569387-093e-4a2c-ae90-8604a44600d8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-volume_attachments/7ba749ef-3f3d-4465-a108-e472c26d7a64" status: 202 len: 0 microversion: 2.1 time: 0.165029 Sep 28 16:02:53.957389 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 571/970] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 16:02:53 2022] DELETE /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-volume_attachments/7ba749ef-3f3d-4465-a108-e472c26d7a64 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 16:02:53.966578 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:53.969028 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:53.975211 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:53.975692 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:53.976124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:53.976836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:53.977412 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:53.977841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:54.011408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-b66074a7-dab9-4399-91d1-525bf9ee6f94 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049520 Sep 28 16:02:54.011972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 572/971] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 16:02:53 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:02:55.023800 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:55.025953 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:55.032373 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:55.032853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:55.033349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:55.034004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:55.034481 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:55.034905 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:55.064616 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c5e803c1-845e-4bfe-abe8-01f17bcfe7e1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044765 Sep 28 16:02:55.065196 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 573/972] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 16:02:55 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 16:02:55.129962 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:55.130472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:55.136621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:55.137103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:55.137537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:55.138232 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:55.138713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:55.139134 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:55.164946 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 16:02:55.240464 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-80ec5a8c-3134-43fe-b826-fbc0b539dc2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 204 len: 0 microversion: 2.1 time: 0.114056 Sep 28 16:02:55.241166 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 574/973] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:02:55 2022] DELETE /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 16:02:55.250192 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:55.250918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:55.256960 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:55.257438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:55.257872 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:55.258613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:55.259067 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:55.259500 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:55.391140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:02:55.398933 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dcb648e7-6b8e-4dfb-b672-1382dc737e7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1682 microversion: 2.1 time: 0.152832 Sep 28 16:02:55.399502 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 575/974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:02:55 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:02:56.421841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:56.422493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:56.428892 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:56.429372 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:56.429803 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:56.430518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:56.430969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:56.431392 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:56.558206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:02:56.566260 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ce5c5cbc-25ba-47ea-9bb7-0502464ce0c3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1682 microversion: 2.1 time: 0.148317 Sep 28 16:02:56.566896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 576/975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:02:56 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:02:57.589853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:57.591203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:57.596787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:57.597270 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:57.597748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:57.598396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:57.599221 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:57.599829 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:57.604494 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:02:57.677366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:02:57.686407 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fecec3cf-24be-4b32-93fb-7c27e13de50a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 200 len: 1614 microversion: 2.1 time: 0.101038 Sep 28 16:02:57.687124 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 577/976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:02:57 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:02:57.854499 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-8e344bcb-1fec-410c-a2b5-3a44e573a6bd req-254753ee-bee8-49f9-aa64-6934a2807741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dca5965-cf72-45f0-ae5c-db8e8fd01cd2", "name": "network-vif-deleted", "tag": "e0993302-f321-4848-b011-5ee2bbebc2fc"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:02:57.863833 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8e344bcb-1fec-410c-a2b5-3a44e573a6bd req-254753ee-bee8-49f9-aa64-6934a2807741 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:57.864320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8e344bcb-1fec-410c-a2b5-3a44e573a6bd req-254753ee-bee8-49f9-aa64-6934a2807741 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:57.864726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-8e344bcb-1fec-410c-a2b5-3a44e573a6bd req-254753ee-bee8-49f9-aa64-6934a2807741 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:57.886817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-8e344bcb-1fec-410c-a2b5-3a44e573a6bd req-254753ee-bee8-49f9-aa64-6934a2807741 service nova] Creating event network-vif-deleted:e0993302-f321-4848-b011-5ee2bbebc2fc for instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 on hv-cinder-85931 Sep 28 16:02:57.894943 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-8e344bcb-1fec-410c-a2b5-3a44e573a6bd req-254753ee-bee8-49f9-aa64-6934a2807741 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043870 Sep 28 16:02:57.896584 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 578/977] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:02:58.711547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:58.712253 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:02:58.719227 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:58.719708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:58.720138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:58.720836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:02:58.721281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:02:58.721699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:02:58.736117 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 HTTP/1.1 Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:02:58.737782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:02:58.739349 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '9dca5965-cf72-45f0-ae5c-db8e8fd01cd2'} Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:02:58.740506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:02:58.742198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:02:58.744008 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:02:58.744008 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5021c5ae-7c35-4bc9-8d22-49433dd658cb tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 404 len: 111 microversion: 2.1 time: 0.032509 Sep 28 16:02:58.744008 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 579/978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:02:58 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:02:58.747964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-065b06ac-6c65-4268-9a84-870ced246356 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '.version_select at 0x7f8fcfb1cca0>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:02:58.768522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-065b06ac-6c65-4268-9a84-870ced246356 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-972795262" status: 202 len: 0 microversion: 2.1 time: 0.024189 Sep 28 16:02:58.769104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 580/979] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 28 16:02:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-972795262 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 16:02:59.448961 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-deff7250-7976-498c-93a9-a6f957270bb2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: .version_select at 0x7f8fcfd2c8b0>, body: {"keypair": {"name": "tempest-keypair-1675711304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa/Z4WPyPjHo/VEDJG8TtWKri9F/VSkwmbDKGA937mduuMe+vreGom2DiZlNrOPJHpDl/0JtQkmIZQzgls+gxc3SlIJbPaO0/U9Bhp4MP6C/XpNQ+n6iZIB4zVAdvDArg=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:02:59.465215 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-deff7250-7976-498c-93a9-a6f957270bb2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for project 9cf83fa74c6648ba959db6679857c466. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:02:59.469061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-deff7250-7976-498c-93a9-a6f957270bb2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for user ef337fd87e3a46c68339951fc72a281b and project 9cf83fa74c6648ba959db6679857c466. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:02:59.490530 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-deff7250-7976-498c-93a9-a6f957270bb2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046190 Sep 28 16:02:59.491117 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 581/980] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 16:02:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:03:00.773281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-381585257", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8ee297b-b45a-42fe-98ce-2cb512c2c741"}], "security_groups": [{"name": "tempest-securitygroup--1989985532"}], "key_name": "tempest-keypair-1675711304", "user_data": "}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:03:00.894795 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] validate_networks() for [('d8ee297b-b45a-42fe-98ce-2cb512c2c741', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 16:03:01.274062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 16:03:01.274596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 16:03:01.275070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 16:03:01.275474 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 16:03:01.275882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 16:03:01.284639 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:01.285108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:01.285532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:01.286251 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:01.286722 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:01.287141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:01.303788 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for project 9cf83fa74c6648ba959db6679857c466. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:03:01.308394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for user ef337fd87e3a46c68339951fc72a281b and project 9cf83fa74c6648ba959db6679857c466. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:03:01.319525 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 16:03:01.321840 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 16:03:01.371032 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2b64f9e8-6c05-4596-be7e-dfd64bbf5953 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.603939 Sep 28 16:03:01.372034 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 582/981] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 16:03:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 16:03:01.382994 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3bff0d20-ef58-414a-9eb4-4d371fb6f15d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:01.383594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3bff0d20-ef58-414a-9eb4-4d371fb6f15d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:01.439046 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-3bff0d20-ef58-414a-9eb4-4d371fb6f15d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:01.446000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3bff0d20-ef58-414a-9eb4-4d371fb6f15d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1241 microversion: 2.1 time: 0.067150 Sep 28 16:03:01.446809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 583/982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:01 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:02.469459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:02.471089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:02.479118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:02.479727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:02.480990 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:02.482136 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:02.482848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:02.483521 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:02.567333 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:02.576019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-05bbfd59-ab62-499f-b5a5-f98841163b71 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1311 microversion: 2.1 time: 0.111161 Sep 28 16:03:02.576591 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 584/983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:02 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:03.598478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:03.599222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:03.606293 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:03.606875 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:03.607311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:03.608013 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:03.608455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:03.608869 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:03.832405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:03.840758 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-77d8b5c6-93f4-44ad-a33a-54c13f65ed92 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1367 microversion: 2.1 time: 0.246272 Sep 28 16:03:03.841410 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 585/984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:03 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:03.976375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-635fdf68-d098-478d-999a-37ce220b4c90 req-bab80efb-ad7a-4ffa-8230-fe6b1ede5011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131ac848-f782-4ce5-ba23-3fa3bee28f1a", "tag": "946ec811-5f40-44af-bc8a-6ff53148e84a"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:03:03.986845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-635fdf68-d098-478d-999a-37ce220b4c90 req-bab80efb-ad7a-4ffa-8230-fe6b1ede5011 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:03.987656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-635fdf68-d098-478d-999a-37ce220b4c90 req-bab80efb-ad7a-4ffa-8230-fe6b1ede5011 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:03.988081 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-635fdf68-d098-478d-999a-37ce220b4c90 req-bab80efb-ad7a-4ffa-8230-fe6b1ede5011 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:03.999689 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-635fdf68-d098-478d-999a-37ce220b4c90 req-bab80efb-ad7a-4ffa-8230-fe6b1ede5011 service nova] Creating event network-changed:946ec811-5f40-44af-bc8a-6ff53148e84a for instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a on hv-cinder-85931 Sep 28 16:03:04.004814 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-635fdf68-d098-478d-999a-37ce220b4c90 req-bab80efb-ad7a-4ffa-8230-fe6b1ede5011 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032195 Sep 28 16:03:04.005408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 586/985] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:03:04.865984 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:04.866712 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:04.873749 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:04.874248 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:04.874717 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:04.875413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:04.875863 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:04.876282 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:05.094326 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:05.101899 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-49da5bbb-4709-4191-ac23-e1cfb2655b7d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1367 microversion: 2.1 time: 0.241104 Sep 28 16:03:05.102487 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 587/986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:04 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:06.125493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:06.126147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:06.132585 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:06.133058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:06.133492 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:06.134175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:06.134726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:06.135146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:06.263008 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:06.270691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ac732c58-df01-4e51-90db-099797ad495b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1367 microversion: 2.1 time: 0.149034 Sep 28 16:03:06.271257 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 588/987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:06 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:07.293178 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:07.293783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:07.297321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:03:07.301365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:07.301843 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:07.302273 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:07.302992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:07.303438 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:07.303855 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:07.436572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:07.444503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-79cfe6ca-3038-4de2-a435-a07d0527bfbd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1367 microversion: 2.1 time: 0.155245 Sep 28 16:03:07.445077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 589/988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:07 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:08.468652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:08.469336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:08.475768 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:08.476254 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:08.476682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:08.477369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:08.477816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:08.478265 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:08.605906 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:08.613701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-39b9f6aa-10f3-4ebb-a779-d7b3949c50d1 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1367 microversion: 2.1 time: 0.148926 Sep 28 16:03:08.614300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 590/989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:08 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:09.633065 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-6845cd7c-8a74-47db-a1c9-52abc364cc7c req-ffe18db5-82f4-4e1e-b21f-eebc6db1a32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131ac848-f782-4ce5-ba23-3fa3bee28f1a", "name": "network-vif-plugged", "status": "completed", "tag": "946ec811-5f40-44af-bc8a-6ff53148e84a"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:03:09.644169 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6845cd7c-8a74-47db-a1c9-52abc364cc7c req-ffe18db5-82f4-4e1e-b21f-eebc6db1a32a service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:09.644648 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6845cd7c-8a74-47db-a1c9-52abc364cc7c req-ffe18db5-82f4-4e1e-b21f-eebc6db1a32a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:09.645077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-6845cd7c-8a74-47db-a1c9-52abc364cc7c req-ffe18db5-82f4-4e1e-b21f-eebc6db1a32a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:09.658599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-6845cd7c-8a74-47db-a1c9-52abc364cc7c req-ffe18db5-82f4-4e1e-b21f-eebc6db1a32a service nova] Creating event network-vif-plugged:946ec811-5f40-44af-bc8a-6ff53148e84a for instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a on hv-cinder-85931 Sep 28 16:03:09.663588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-6845cd7c-8a74-47db-a1c9-52abc364cc7c req-ffe18db5-82f4-4e1e-b21f-eebc6db1a32a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034527 Sep 28 16:03:09.664375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 591/990] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:03:09.670021 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:09.670653 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:09.676669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:09.677249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:09.677818 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:09.678669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:09.679225 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:09.679650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:09.814848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:09.823954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d8ac6772-cabf-493e-b357-ec0b1bbabb18 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1367 microversion: 2.1 time: 0.158573 Sep 28 16:03:09.824522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 592/991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:09 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:03:10.847489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:10.848164 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:10.855447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:10.855926 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:10.856358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:10.857048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:10.857495 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:10.857912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:10.990075 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:10.998362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5dcff248-526c-467d-9fb8-ea8d33aec855 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1367 microversion: 2.1 time: 0.155281 Sep 28 16:03:10.998958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 593/992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:10 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:12.021069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:12.021746 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:12.023635 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:03:12.024451 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=12 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:03:12.030275 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:12.030776 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:12.031206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:12.031890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:12.032331 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:12.032751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:12.169382 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:03:12.177175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-da0bc649-869f-4601-914c-c790cceddbd2 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1557 microversion: 2.1 time: 0.159944 Sep 28 16:03:12.177745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 594/993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:03:12 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:03:12.199678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:03:12.200162 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:03:12.205883 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:12.206358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:12.206812 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:12.207496 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:12.207938 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:12.208356 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:12.284528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-880756c5-caf2-4a40-8e40-6258295f288e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088945 Sep 28 16:03:12.285131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 595/994] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 16:03:12 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:03:13.203277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-3a51e2c4-c024-4a9b-a406-fca3bd2f132b req-68508247-7611-43f8-b732-39e3f68108ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131ac848-f782-4ce5-ba23-3fa3bee28f1a", "tag": "946ec811-5f40-44af-bc8a-6ff53148e84a"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:03:13.212554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3a51e2c4-c024-4a9b-a406-fca3bd2f132b req-68508247-7611-43f8-b732-39e3f68108ad service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:03:13.213018 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3a51e2c4-c024-4a9b-a406-fca3bd2f132b req-68508247-7611-43f8-b732-39e3f68108ad service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:03:13.214070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3a51e2c4-c024-4a9b-a406-fca3bd2f132b req-68508247-7611-43f8-b732-39e3f68108ad service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:03:13.225258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-3a51e2c4-c024-4a9b-a406-fca3bd2f132b req-68508247-7611-43f8-b732-39e3f68108ad service nova] Creating event network-changed:946ec811-5f40-44af-bc8a-6ff53148e84a for instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a on hv-cinder-85931 Sep 28 16:03:13.231348 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-3a51e2c4-c024-4a9b-a406-fca3bd2f132b req-68508247-7611-43f8-b732-39e3f68108ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032101 Sep 28 16:03:13.231940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 596/995] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:26.199429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=14 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:04:26.200171 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=74 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:04:26.205092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:26.205716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:26.212582 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:26.213063 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:26.213491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:26.214177 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:26.214658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:26.215079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:26.239150 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f7acdeed-f7b3-4169-9936-9a7b927d53a3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/ips" status: 200 len: 150 microversion: 2.1 time: 0.041927 Sep 28 16:04:26.239725 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 597/996] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 16:04:26 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:27.571415 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e426c73d-abf5-44a7-a4d9-cd0b7c210ed1"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:04:27.573790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:27.580174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:27.580649 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:27.581077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:27.581763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:27.582206 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:27.582667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:27.842033 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-720badf1-d0e8-4936-b829-36950eaa19b8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274369 Sep 28 16:04:27.843444 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 598/997] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 16:04:27 2022] POST /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:35.388520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e426c73d-abf5-44a7-a4d9-cd0b7c210ed1"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:04:35.391594 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:35.397964 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:35.398469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:35.398910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:35.399611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:35.400057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:35.400498 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:35.496780 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Invalid volume: volume e426c73d-abf5-44a7-a4d9-cd0b7c210ed1 is already attached to instances: 131ac848-f782-4ce5-ba23-3fa3bee28f1a Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: POST /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments HTTP/1.1 Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 74 Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:04:35.499159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {"volumeAttachment": {"volumeId": "e426c73d-abf5-44a7-a4d9-cd0b7c210ed1"}} Sep 28 16:04:35.500621 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Invalid volume: volume e426c73d-abf5-44a7-a4d9-cd0b7c210ed1 is already attached to instances: 131ac848-f782-4ce5-ba23-3fa3bee28f1a Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'server_id': '131ac848-f782-4ce5-ba23-3fa3bee28f1a', 'body': {'volumeAttachment': {'volumeId': 'e426c73d-abf5-44a7-a4d9-cd0b7c210ed1'}}} Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e426c73d-abf5-44a7-a4d9-cd0b7c210ed1 is already attached to instances: 131ac848-f782-4ce5-ba23-3fa3bee28f1a Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:35.501513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e426c73d-abf5-44a7-a4d9-cd0b7c210ed1 is already attached to instances: 131ac848-f782-4ce5-ba23-3fa3bee28f1a Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:04:35.503140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:04:35.504807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:04:35.504807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:04:35.504807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:04:35.504807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e426c73d-abf5-44a7-a4d9-cd0b7c210ed1 is already attached to instances: 131ac848-f782-4ce5-ba23-3fa3bee28f1a Sep 28 16:04:35.504807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:35.504807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 400 to user: Invalid volume: volume e426c73d-abf5-44a7-a4d9-cd0b7c210ed1 is already attached to instances: 131ac848-f782-4ce5-ba23-3fa3bee28f1a {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:04:35.504807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-444d1729-1752-4cdb-9585-eeaabca1e952 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116956 Sep 28 16:04:35.504807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 599/998] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 16:04:35 2022] POST /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 28 16:04:35.570464 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:35.570963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:35.577539 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:35.578022 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:35.578513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:35.579218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:35.579669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:35.580089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:35.664729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lazy-loading 'services' on Instance uuid 131ac848-f782-4ce5-ba23-3fa3bee28f1a {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 16:04:35.740617 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0d7509f6-8f26-48ab-8d5c-1fc220710504 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments/e426c73d-abf5-44a7-a4d9-cd0b7c210ed1" status: 202 len: 0 microversion: 2.1 time: 0.173908 Sep 28 16:04:35.741345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 600/999] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 16:04:35 2022] DELETE /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments/e426c73d-abf5-44a7-a4d9-cd0b7c210ed1 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 16:04:35.754865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:35.754865 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:35.761130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:35.761876 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:35.762279 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:35.763162 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:35.763951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:35.764633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:35.796887 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8068a390-ef8e-4b8d-a99c-30150c9ce51a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050931 Sep 28 16:04:35.797492 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 601/1000] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 16:04:35 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:36.809391 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:36.812127 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:36.818910 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:36.819388 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:36.819821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:36.820512 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:36.820963 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:36.821413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:36.850518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-29e61f4b-c7a6-4561-8e0c-b710c174a121 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045133 Sep 28 16:04:36.851080 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 602/1001] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 16:04:36 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 16:04:36.914615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:36.915110 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:36.921533 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:36.922097 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:36.922472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:36.923433 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:36.923890 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:36.924313 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:36.949441 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 16:04:37.025146 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-85d141bb-a946-4d26-b2ce-18d23886526f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 204 len: 0 microversion: 2.1 time: 0.113917 Sep 28 16:04:37.025923 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 603/1002] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:04:36 2022] DELETE /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 16:04:37.035450 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:37.036220 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:37.043035 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:37.043524 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:37.043948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:37.044645 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:37.045094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:37.046053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:37.178630 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:37.187082 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ea17ba5c-6c12-450c-9e90-6510e9e149c4 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1682 microversion: 2.1 time: 0.156355 Sep 28 16:04:37.187652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 604/1003] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:37 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:38.209458 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:38.210155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:38.216705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:38.217245 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:38.217740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:38.218478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:38.218925 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:38.219342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:38.350470 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:38.358330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2bf64670-2bef-4e55-9a29-e27b674630f3 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1682 microversion: 2.1 time: 0.152588 Sep 28 16:04:38.358996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 605/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:38 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:39.381297 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:39.381911 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:39.391612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:39.392316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:39.392941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:39.393977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:39.394078 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:39.394760 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:39.464822 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:39.474212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8dc14cd4-9c11-4608-92c5-6f71ca03513b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 200 len: 1614 microversion: 2.1 time: 0.096878 Sep 28 16:04:39.474823 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 606/1005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:39 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:39.687371 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-48345ee9-2a23-4c04-b3bb-49962a6332d7 req-20f7f4e2-b897-4c46-a57b-c79a4f08da0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131ac848-f782-4ce5-ba23-3fa3bee28f1a", "name": "network-vif-deleted", "tag": "946ec811-5f40-44af-bc8a-6ff53148e84a"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:04:39.698782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-48345ee9-2a23-4c04-b3bb-49962a6332d7 req-20f7f4e2-b897-4c46-a57b-c79a4f08da0d service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:39.699163 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-48345ee9-2a23-4c04-b3bb-49962a6332d7 req-20f7f4e2-b897-4c46-a57b-c79a4f08da0d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:39.699599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-48345ee9-2a23-4c04-b3bb-49962a6332d7 req-20f7f4e2-b897-4c46-a57b-c79a4f08da0d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:39.720174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-48345ee9-2a23-4c04-b3bb-49962a6332d7 req-20f7f4e2-b897-4c46-a57b-c79a4f08da0d service nova] Creating event network-vif-deleted:946ec811-5f40-44af-bc8a-6ff53148e84a for instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a on hv-cinder-85931 Sep 28 16:04:39.725364 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-48345ee9-2a23-4c04-b3bb-49962a6332d7 req-20f7f4e2-b897-4c46-a57b-c79a4f08da0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042501 Sep 28 16:04:39.726009 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 607/1006] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:40.498844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:40.499566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:40.505922 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:40.506403 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:40.506915 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:40.507613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:40.508060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:40.508479 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:40.522542 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a HTTP/1.1 Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:04:40.524252 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:04:40.526718 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '131ac848-f782-4ce5-ba23-3fa3bee28f1a'} Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:04:40.527536 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:04:40.528969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:04:40.531145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:04:40.531145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0d5b986a-aba0-4daf-8476-7d174e001f6d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 404 len: 111 microversion: 2.1 time: 0.031771 Sep 28 16:04:40.531145 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 608/1007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:40 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:04:40.534857 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-33952d09-469a-4d04-ae0c-c1467dc59cb0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '.version_select at 0x7f8fcfb28550>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:40.555290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-33952d09-469a-4d04-ae0c-c1467dc59cb0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675711304" status: 202 len: 0 microversion: 2.1 time: 0.023967 Sep 28 16:04:40.555907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 609/1008] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 28 16:04:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675711304 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 16:04:41.185862 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-caee736e-096d-49f3-b383-f0d6dd5c552f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: .version_select at 0x7f8fcfac8ee0>, body: {"keypair": {"name": "tempest-keypair-1765049511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWmAToHDG5RvX9SFTkdnDhW1yRh4WcICeu4qsIuQOup9PiZozsow2islJZ53OKMjyapULJIiq18rLPliwk10Czy2u5G9v3TtgANbbH38XlmRQ4rsK1BRUSQ0JjBwDfoOA=="}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:04:41.201729 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-caee736e-096d-49f3-b383-f0d6dd5c552f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for project 9cf83fa74c6648ba959db6679857c466. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:04:41.205518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-caee736e-096d-49f3-b383-f0d6dd5c552f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for user ef337fd87e3a46c68339951fc72a281b and project 9cf83fa74c6648ba959db6679857c466. Resources: {'key_pairs'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:04:41.227459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-caee736e-096d-49f3-b383-f0d6dd5c552f tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045596 Sep 28 16:04:41.228050 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 610/1009] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 28 16:04:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:42.437142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-19721991", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8ee297b-b45a-42fe-98ce-2cb512c2c741"}], "security_groups": [{"name": "tempest-securitygroup--864527161"}], "key_name": "tempest-keypair-1765049511", "user_data": "}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:04:42.543132 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] validate_networks() for [('d8ee297b-b45a-42fe-98ce-2cb512c2c741', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 16:04:42.965183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 16:04:42.965630 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 16:04:42.966104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 16:04:42.966567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 16:04:42.966966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 16:04:42.975674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:42.976233 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:42.976576 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:42.977296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:42.977744 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:42.978164 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:42.994485 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for project 9cf83fa74c6648ba959db6679857c466. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:04:42.998997 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Getting quotas for user ef337fd87e3a46c68339951fc72a281b and project 9cf83fa74c6648ba959db6679857c466. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:04:43.010037 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 16:04:43.012357 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 16:04:43.061246 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c84f1051-766e-46c1-b3ff-8b12b9a12bd6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.628872 Sep 28 16:04:43.062210 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 611/1010] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 16:04:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 16:04:43.073336 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-72f5e61e-ddd3-44a3-a1e0-c7e8f7a6adc7 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:43.074054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-72f5e61e-ddd3-44a3-a1e0-c7e8f7a6adc7 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:43.131579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-72f5e61e-ddd3-44a3-a1e0-c7e8f7a6adc7 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:43.140101 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-72f5e61e-ddd3-44a3-a1e0-c7e8f7a6adc7 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1240 microversion: 2.1 time: 0.070628 Sep 28 16:04:43.140676 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 612/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:43 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:44.165560 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:44.166248 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:44.173987 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:44.174499 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:44.174933 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:44.175636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:44.176079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:44.176500 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:44.468077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:44.476658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-6ed6b793-c55b-4a67-bf29-5b0fc201f656 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1310 microversion: 2.1 time: 0.314951 Sep 28 16:04:44.477250 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 613/1012] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:44 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1310 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:04:45.498640 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:45.499369 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:45.506540 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:45.507136 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:45.507641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:45.508419 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:45.508934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:45.509423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:45.700544 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:45.709776 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-94c47446-99c0-4491-ae75-6682ce655d08 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1365 microversion: 2.1 time: 0.215084 Sep 28 16:04:45.710365 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 614/1013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:45 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:45.848070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-9603b0d9-b404-4f51-ab2f-252a41d60037 req-1d599fec-3865-4aca-862d-7c77191a2814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48677d2d-fd3a-4ade-965d-3a9f2be4a44e", "tag": "9654398e-bc05-4529-a58d-441d4dc13301"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:04:45.859941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9603b0d9-b404-4f51-ab2f-252a41d60037 req-1d599fec-3865-4aca-862d-7c77191a2814 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:45.860661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9603b0d9-b404-4f51-ab2f-252a41d60037 req-1d599fec-3865-4aca-862d-7c77191a2814 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:45.861262 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-9603b0d9-b404-4f51-ab2f-252a41d60037 req-1d599fec-3865-4aca-862d-7c77191a2814 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:45.865889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:04:45.874346 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-9603b0d9-b404-4f51-ab2f-252a41d60037 req-1d599fec-3865-4aca-862d-7c77191a2814 service nova] Creating event network-changed:9654398e-bc05-4529-a58d-441d4dc13301 for instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e on hv-cinder-85931 Sep 28 16:04:45.880286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-9603b0d9-b404-4f51-ab2f-252a41d60037 req-1d599fec-3865-4aca-862d-7c77191a2814 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046079 Sep 28 16:04:45.881222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 615/1014] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:46.734307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:46.735064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:46.743226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:46.743704 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:46.744130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:46.744811 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:46.745253 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:46.745678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:46.884040 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:46.891798 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-322c9fbb-d9ed-4bc7-b923-10c575fd366d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1365 microversion: 2.1 time: 0.162253 Sep 28 16:04:46.892382 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 616/1015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:46 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:47.915397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:47.916076 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:47.923142 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:47.923619 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:47.924049 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:47.924740 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:47.925186 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:47.925602 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:48.055232 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:48.064095 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-1fe5d075-3f6f-4289-a9e0-0d2b77e51a4d tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1365 microversion: 2.1 time: 0.152535 Sep 28 16:04:48.064693 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 617/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:47 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:49.087013 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:49.087708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:49.094147 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:49.094659 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:49.095085 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:49.095761 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:49.096218 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:49.096666 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:49.237255 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:49.244808 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0a898ed9-1811-44cb-93d6-9bcad4c5becc tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1365 microversion: 2.1 time: 0.161652 Sep 28 16:04:49.245352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 618/1017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:49 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:50.099277 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-ed64a537-8afe-4842-a0ab-f7862b3aeb5a req-6bd36e0a-277f-4a20-b5fc-e7e63a9985fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48677d2d-fd3a-4ade-965d-3a9f2be4a44e", "name": "network-vif-plugged", "status": "completed", "tag": "9654398e-bc05-4529-a58d-441d4dc13301"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:04:50.110037 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-ed64a537-8afe-4842-a0ab-f7862b3aeb5a req-6bd36e0a-277f-4a20-b5fc-e7e63a9985fa service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:50.111408 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-ed64a537-8afe-4842-a0ab-f7862b3aeb5a req-6bd36e0a-277f-4a20-b5fc-e7e63a9985fa service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:50.111844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-ed64a537-8afe-4842-a0ab-f7862b3aeb5a req-6bd36e0a-277f-4a20-b5fc-e7e63a9985fa service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:50.123816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-ed64a537-8afe-4842-a0ab-f7862b3aeb5a req-6bd36e0a-277f-4a20-b5fc-e7e63a9985fa service nova] Creating event network-vif-plugged:9654398e-bc05-4529-a58d-441d4dc13301 for instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e on hv-cinder-85931 Sep 28 16:04:50.128853 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-ed64a537-8afe-4842-a0ab-f7862b3aeb5a req-6bd36e0a-277f-4a20-b5fc-e7e63a9985fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Sep 28 16:04:50.129650 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 619/1018] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:50.272083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:50.272784 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:50.280203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:50.280727 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:50.281200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:50.281971 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:50.282478 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:50.282951 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:50.467815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:50.484511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-660d064f-dec1-4d52-a888-57e69388dca0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1365 microversion: 2.1 time: 0.218311 Sep 28 16:04:50.487297 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 620/1019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:50 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:04:51.510954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:51.511628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:51.518137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:51.518568 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:51.518996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:51.519698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:51.520137 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:51.520548 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:51.655245 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:51.662969 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e65cec41-e525-467e-ac41-fd7bea03a6f6 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1365 microversion: 2.1 time: 0.155927 Sep 28 16:04:51.663537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 621/1020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:51 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:52.685342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:52.686106 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:52.692783 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:52.693260 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:52.693691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:52.694380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:52.694851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:52.695270 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:52.824342 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:04:52.832046 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4666f33f-acf4-4a4b-be71-0db252a81d7b tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1555 microversion: 2.1 time: 0.150804 Sep 28 16:04:52.832622 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 622/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:04:52 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:04:52.854174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:04:52.854675 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:04:52.860934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:52.861413 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:52.861840 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:52.862551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:52.862998 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:52.863417 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:52.939978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-611f8512-c7dd-4c5f-bc18-b30e59d7b23e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089305 Sep 28 16:04:52.940581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 623/1022] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 28 16:04:52 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:04:53.855972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:04:53.856773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=12 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:04:53.918858 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-b9917b64-3380-47c9-89f7-816295194c58 req-bf6a6585-9cd1-4bd3-b54e-e65edc4eb6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48677d2d-fd3a-4ade-965d-3a9f2be4a44e", "tag": "9654398e-bc05-4529-a58d-441d4dc13301"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:04:53.929018 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b9917b64-3380-47c9-89f7-816295194c58 req-bf6a6585-9cd1-4bd3-b54e-e65edc4eb6f0 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:04:53.929572 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b9917b64-3380-47c9-89f7-816295194c58 req-bf6a6585-9cd1-4bd3-b54e-e65edc4eb6f0 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:04:53.930066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-b9917b64-3380-47c9-89f7-816295194c58 req-bf6a6585-9cd1-4bd3-b54e-e65edc4eb6f0 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:04:53.944282 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-b9917b64-3380-47c9-89f7-816295194c58 req-bf6a6585-9cd1-4bd3-b54e-e65edc4eb6f0 service nova] Creating event network-changed:9654398e-bc05-4529-a58d-441d4dc13301 for instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e on hv-cinder-85931 Sep 28 16:04:53.949321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-b9917b64-3380-47c9-89f7-816295194c58 req-bf6a6585-9cd1-4bd3-b54e-e65edc4eb6f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094033 Sep 28 16:04:53.950052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 624/1023] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:05:08.039071 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 16:05:08.039673 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:05:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 16:05:19.986203 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 16:05:19.986921 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:05:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 16:05:19.987504 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 16:05:19.987666 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:05:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 16:05:58.587425 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:05:58.588081 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=44 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:05:58.639212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:05:58.639827 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:05:58.646030 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:05:58.646553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:05:58.646985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:05:58.647677 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:05:58.648119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:05:58.648535 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:05:58.673242 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bccd922b-bf33-4e21-9bb1-021135412416 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/ips" status: 200 len: 150 microversion: 2.1 time: 0.088062 Sep 28 16:05:58.674889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 625/1024] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 28 16:05:58 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:06:00.023351 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8f4677f-74fe-4e0c-8ffa-33ffd82fdb04"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:06:00.025696 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:00.032851 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:00.033354 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:00.033791 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:00.034500 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:00.034979 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:00.035399 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:00.305946 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ce03abb6-7265-466e-b27d-efd6a6aa041c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "POST /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286341 Sep 28 16:06:00.306596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 626/1025] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 16:06:00 2022] POST /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:06:07.963912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:07.964682 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:07.971584 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:07.972068 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:07.972528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:07.973225 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:07.973670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:07.974086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:08.055549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lazy-loading 'services' on Instance uuid 48677d2d-fd3a-4ade-965d-3a9f2be4a44e {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 16:06:08.129363 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-60135818-9b50-40ca-b272-23b29cf2e6cf tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-volume_attachments/a8f4677f-74fe-4e0c-8ffa-33ffd82fdb04" status: 202 len: 0 microversion: 2.1 time: 0.170132 Sep 28 16:06:08.130269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 627/1026] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 16:06:07 2022] DELETE /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-volume_attachments/a8f4677f-74fe-4e0c-8ffa-33ffd82fdb04 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 16:06:08.139658 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:08.142579 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:08.148887 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:08.149467 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:08.150092 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:08.151103 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:08.151549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:08.151970 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:08.184817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-27b98d24-6a92-4e40-8f66-061f3e8b202c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049146 Sep 28 16:06:08.185699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 628/1027] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 16:06:08 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:06:09.198149 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:09.200448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:09.209185 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:09.209774 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:09.210224 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:09.210974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:09.211426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:09.211848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:09.240930 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-92092e37-ae36-4ab1-987d-6b804034dd2e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047149 Sep 28 16:06:09.241506 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 629/1028] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 28 16:06:09 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 16:06:09.305957 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:09.306477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:09.313159 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:09.313642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:09.314074 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:09.314786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:09.315236 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:09.315661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:09.340862 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 16:06:09.415599 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-bb85ba3a-5824-4381-b1d4-9a2aa4593f62 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 204 len: 0 microversion: 2.1 time: 0.113064 Sep 28 16:06:09.416491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 630/1029] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:06:09 2022] DELETE /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 16:06:09.425167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:09.425920 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:09.431748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:09.432224 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:09.432655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:09.433340 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:09.433787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:09.434216 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:09.568131 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:09.575871 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-ed9191aa-7ebb-48dc-a38c-ddaeb2a379e8 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1680 microversion: 2.1 time: 0.155029 Sep 28 16:06:09.576444 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 631/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:09 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:10.599553 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:10.600315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:10.606441 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:10.606928 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:10.607498 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:10.608231 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:10.608671 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:10.609083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:10.745419 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:10.754748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-92b0d9a7-89b3-49bb-b2c1-3a7d16ff095e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1680 microversion: 2.1 time: 0.159298 Sep 28 16:06:10.755325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 632/1031] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:10 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:11.778655 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:11.780660 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:11.787163 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:11.787721 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:11.788219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:11.788997 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:11.789509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:11.789992 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:11.876699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef337fd87e3a46c68339951fc72a281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf83fa74c6648ba959db6679857c466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:11.891654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5d4eaffe-5382-44d4-a9fe-93bacd2ac432 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 200 len: 1613 microversion: 2.1 time: 0.116910 Sep 28 16:06:11.902624 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 633/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:11 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 1613 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:12.149299 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-3cf662e8-2056-4df2-8dd8-8fb90b9f2240 req-921017a4-4ddd-4ddf-b355-bd48f6a511f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48677d2d-fd3a-4ade-965d-3a9f2be4a44e", "name": "network-vif-deleted", "tag": "9654398e-bc05-4529-a58d-441d4dc13301"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:06:12.158932 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3cf662e8-2056-4df2-8dd8-8fb90b9f2240 req-921017a4-4ddd-4ddf-b355-bd48f6a511f2 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:12.159394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3cf662e8-2056-4df2-8dd8-8fb90b9f2240 req-921017a4-4ddd-4ddf-b355-bd48f6a511f2 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:12.159815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-3cf662e8-2056-4df2-8dd8-8fb90b9f2240 req-921017a4-4ddd-4ddf-b355-bd48f6a511f2 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:12.171203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-3cf662e8-2056-4df2-8dd8-8fb90b9f2240 req-921017a4-4ddd-4ddf-b355-bd48f6a511f2 service nova] Creating event network-vif-deleted:9654398e-bc05-4529-a58d-441d4dc13301 for instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e on hv-cinder-85931 Sep 28 16:06:12.176129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-3cf662e8-2056-4df2-8dd8-8fb90b9f2240 req-921017a4-4ddd-4ddf-b355-bd48f6a511f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030437 Sep 28 16:06:12.177041 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 634/1033] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:06:12.916064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:12.916779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:12.923275 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:12.923751 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:12.924174 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:12.924880 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:12.925306 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:12.925717 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:12.940427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e HTTP/1.1 Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:12.942111 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:12.943841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '48677d2d-fd3a-4ade-965d-3a9f2be4a44e'} Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:12.944701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:12.946345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:12.948516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:12.948516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2b1e00d0-def9-41de-ba10-111d31b5703c tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 404 len: 111 microversion: 2.1 time: 0.032205 Sep 28 16:06:12.948516 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 635/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:12 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:06:12.953232 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-99e11efb-bb5b-477a-8f9e-a4520d07bcc7 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '.version_select at 0x7f8fd349c820>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:12.972735 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-99e11efb-bb5b-477a-8f9e-a4520d07bcc7 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765049511" status: 202 len: 0 microversion: 2.1 time: 0.023800 Sep 28 16:06:12.973335 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 636/1035] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 28 16:06:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765049511 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 16:06:14.751143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:14.751773 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:14.758311 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:14.758821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:14.759255 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:14.759946 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:14.760394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:14.760815 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:14.774060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e HTTP/1.1 Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:14.775620 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.777426 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '48677d2d-fd3a-4ade-965d-3a9f2be4a44e'} Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:14.778320 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.780290 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.781628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:14.781628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a2720442-06a0-48ec-ac7f-8641d0aed015 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 404 len: 111 microversion: 2.1 time: 0.030242 Sep 28 16:06:14.781628 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 637/1036] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:06:14 2022] DELETE /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:06:14.787779 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:14.788386 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 48677d2d-fd3a-4ade-965d-3a9f2be4a44e] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:14.794201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:14.794764 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:14.795172 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:14.795897 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:14.796345 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:14.796767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:14.810037 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e HTTP/1.1 Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:14.811552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.813491 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '48677d2d-fd3a-4ade-965d-3a9f2be4a44e'} Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:14.814554 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. Sep 28 16:06:14.817175 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:14.818610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 48677d2d-fd3a-4ade-965d-3a9f2be4a44e could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:14.818610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2d425edd-07d2-4d37-9b4a-88c222611d7a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e" status: 404 len: 111 microversion: 2.1 time: 0.029855 Sep 28 16:06:14.818610 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 638/1037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:14 2022] GET /compute/v2.1/servers/48677d2d-fd3a-4ade-965d-3a9f2be4a44e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 16:06:15.952201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:15.952782 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:15.959061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:15.959524 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:15.959945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:15.960625 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:15.961059 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:15.961469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:15.975221 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a HTTP/1.1 Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:15.976736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:15.978405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '131ac848-f782-4ce5-ba23-3fa3bee28f1a'} Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:15.979294 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:15.980716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:15.983384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:15.983384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7e90ba15-cd80-4271-a888-20a21a6140c0 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 404 len: 111 microversion: 2.1 time: 0.029825 Sep 28 16:06:15.983384 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 639/1038] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:06:15 2022] DELETE /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:06:15.986699 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:15.987289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 131ac848-f782-4ce5-ba23-3fa3bee28f1a] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:15.992958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:15.993423 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:15.993845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:15.994537 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:15.994974 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:15.995383 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:16.008459 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a HTTP/1.1 Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:16.009766 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:16.011461 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '131ac848-f782-4ce5-ba23-3fa3bee28f1a'} Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:16.012307 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. Sep 28 16:06:16.013669 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.014889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 131ac848-f782-4ce5-ba23-3fa3bee28f1a could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:16.014889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f5d51404-0ddf-41e1-bf4c-f01c0f03e274 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a" status: 404 len: 111 microversion: 2.1 time: 0.027963 Sep 28 16:06:16.014889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 640/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:15 2022] GET /compute/v2.1/servers/131ac848-f782-4ce5-ba23-3fa3bee28f1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:06:16.019048 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:16.019519 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:16.025064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:16.025527 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:16.025947 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:16.026661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:16.027100 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:16.027511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:16.042575 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c HTTP/1.1 Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:16.044083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.046347 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'c3aecaca-d1ba-47b4-987e-06a127be3d8c'} Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:16.047409 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.049072 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.050934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:16.050934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c8e785b4-6d3f-442d-9a01-095a6fc5301a tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 404 len: 111 microversion: 2.1 time: 0.030366 Sep 28 16:06:16.050934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 641/1040] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:06:16 2022] DELETE /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:06:16.054339 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:16.054971 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: c3aecaca-d1ba-47b4-987e-06a127be3d8c] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:16.060921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:16.061396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:16.061819 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:16.062532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:16.063234 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:16.063653 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:16.076942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c HTTP/1.1 Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:16.078460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.080062 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'c3aecaca-d1ba-47b4-987e-06a127be3d8c'} Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:16.081020 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. Sep 28 16:06:16.082767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:16.084108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance c3aecaca-d1ba-47b4-987e-06a127be3d8c could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:16.084108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a1cea72a-629d-495b-97ea-a3a302d330cd tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c" status: 404 len: 111 microversion: 2.1 time: 0.029278 Sep 28 16:06:16.084108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 642/1041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:16 2022] GET /compute/v2.1/servers/c3aecaca-d1ba-47b4-987e-06a127be3d8c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:06:17.385569 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:17.386187 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:17.393029 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:17.393504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:17.393936 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:17.394642 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:17.395086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:17.395499 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:17.408520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: DELETE /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 HTTP/1.1 Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:17.410026 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.411562 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '9dca5965-cf72-45f0-ae5c-db8e8fd01cd2'} Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:17.412406 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.413821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.415183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:17.415183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-943b1c05-635d-4ac7-9046-2f761bc7d688 tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 404 len: 111 microversion: 2.1 time: 0.029696 Sep 28 16:06:17.415183 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 643/1042] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:06:17 2022] DELETE /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:06:17.419366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:17.419968 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] [instance: 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:17.425512 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:17.425983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:17.426436 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:17.427118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:17.427565 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:17.427982 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:17.441904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] HTTP exception thrown: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Request method failure captured: Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 HTTP/1.1 Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNG-DD6jgNQAHgKd1NhbmNuWfi_F7UChheZQdmaRwdD3VY-x8yua86KLE8x_Xf_iNUUGW4X9XYk80GQxM15GP5NsdfLl8WvUO0EHazFd2GS-YHW95aAVxIQRMq9BeomFb3Ee1WsWIgAlOF41_P-2QEBbdCeT1djxMPyQ8ThNGtFdEWmU Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:17.443321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9cf83fa74c6648ba959db6679857c466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9cf83fa74c6648ba959db6679857c466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9cf83fa74c6648ba959db6679857c466"}]}] Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9cf83fa74c6648ba959db6679857c466 Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176895909 Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: ef337fd87e3a46c68339951fc72a281b Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-AttachVolumeNegativeTest-176895909-project Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.445116 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': '9dca5965-cf72-45f0-ae5c-db8e8fd01cd2'} Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:17.446096 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. Sep 28 16:06:17.447703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:17.449219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] Returning 404 to user: Instance 9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:17.449219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-32070545-fd96-468e-b3ba-c356f819917e tempest-AttachVolumeNegativeTest-176895909 tempest-AttachVolumeNegativeTest-176895909-project] 10.222.0.60 "GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2" status: 404 len: 111 microversion: 2.1 time: 0.028779 Sep 28 16:06:17.449219 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 644/1043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:17 2022] GET /compute/v2.1/servers/9dca5965-cf72-45f0-ae5c-db8e8fd01cd2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:06:42.194533 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1405222752", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:06:42.203447 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:06:42.204282 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:06:42.254266 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] validate_networks() for None {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 16:06:42.524149 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 16:06:42.524569 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 16:06:42.525037 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 16:06:42.525440 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 16:06:42.525844 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 16:06:42.535304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:42.535777 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:42.536204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:42.536921 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:42.537362 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:42.537776 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:42.554480 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Getting quotas for project c5edadda817042b1af27039d30e8fa68. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:06:42.558472 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Getting quotas for user 21d2ed0f86f141d299e5440bc54eb31b and project c5edadda817042b1af27039d30e8fa68. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:06:42.570367 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 16:06:42.572719 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 16:06:42.618197 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cf7d5cb9-95e6-47db-9ed1-c37fc492c734 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.427514 Sep 28 16:06:42.618881 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 645/1044] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 16:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 16:06:42.630471 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e08e206c-6a30-4236-add9-4726eede5d92 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:42.631089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e08e206c-6a30-4236-add9-4726eede5d92 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:42.688609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e08e206c-6a30-4236-add9-4726eede5d92 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:42.696662 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e08e206c-6a30-4236-add9-4726eede5d92 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1215 microversion: 2.1 time: 0.070029 Sep 28 16:06:42.697240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 646/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:42 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:43.719489 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:43.720167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:43.727261 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:43.727748 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:43.728182 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:43.728878 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:43.729328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:43.729750 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:43.811125 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:43.819249 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-25710c0e-2baf-4e75-b683-7de52d3bf57e tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1275 microversion: 2.1 time: 0.104202 Sep 28 16:06:43.820289 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 647/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:43 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:44.842548 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:44.843404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:44.849601 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:44.850077 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:44.850549 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:44.851221 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:44.851664 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:44.852079 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:45.074221 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:45.082089 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-dbbcf238-3bf9-4b07-b212-f82d5244684c tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.243837 Sep 28 16:06:45.082704 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 648/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:44 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:45.329730 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-a320ce25-9d6f-4545-8586-ec55b6f102f5 req-41f02052-ec26-469d-b1b4-1674680d37af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeee041c-03df-4be6-8b5f-95340ea8b2c2", "tag": "737f6027-0cd0-4a56-98f1-292b3f552d8e"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:06:45.349556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-a320ce25-9d6f-4545-8586-ec55b6f102f5 req-41f02052-ec26-469d-b1b4-1674680d37af service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:45.351039 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-a320ce25-9d6f-4545-8586-ec55b6f102f5 req-41f02052-ec26-469d-b1b4-1674680d37af service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:45.351708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-a320ce25-9d6f-4545-8586-ec55b6f102f5 req-41f02052-ec26-469d-b1b4-1674680d37af service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:45.364237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-a320ce25-9d6f-4545-8586-ec55b6f102f5 req-41f02052-ec26-469d-b1b4-1674680d37af service nova] Creating event network-changed:737f6027-0cd0-4a56-98f1-292b3f552d8e for instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 on hv-cinder-85931 Sep 28 16:06:45.369914 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-a320ce25-9d6f-4545-8586-ec55b6f102f5 req-41f02052-ec26-469d-b1b4-1674680d37af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044285 Sep 28 16:06:45.370904 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 649/1048] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:06:46.107497 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:46.108198 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:46.114520 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:46.115000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:46.115428 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:46.116173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:46.116559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:46.116978 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:46.251141 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:46.258896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d69d1005-8aa8-4f74-baaf-41ae80fc85d1 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.156590 Sep 28 16:06:46.259460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 650/1049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:46 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:47.281293 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:47.281934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:47.288637 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:47.289105 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:47.289527 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:47.290204 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:47.290667 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:47.291083 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:47.421889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:47.429445 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-8139bb26-8666-4bc6-a8cf-4b0a6330fa52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.152041 Sep 28 16:06:47.430008 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 651/1050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:47 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:48.453216 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:48.453881 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:48.460301 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:48.460771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:48.461200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:48.461918 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:48.462370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:48.462809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:48.590759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:48.599094 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5121b9a5-b8f4-4c05-90b8-28c2599f1405 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.150299 Sep 28 16:06:48.599678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 652/1051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:48 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:49.621654 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:49.622284 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:49.629138 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:49.629613 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:49.630043 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:49.630755 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:49.631203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:49.631624 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:49.758287 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:49.766529 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-30c691be-5400-4648-8ae1-04f905e8d939 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.148805 Sep 28 16:06:49.767104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 653/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:49 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:50.789223 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:50.789868 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:50.796993 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:50.797477 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:50.797908 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:50.798635 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:50.799084 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:50.799521 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:50.932479 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:50.940528 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-83fa6a47-faa5-43d4-b341-55bff561e59f tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.155160 Sep 28 16:06:50.941099 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 654/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:50 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:51.963395 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:51.964107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:51.970057 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:51.970561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:51.971010 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:51.971670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:51.972107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:51.972522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:52.097799 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:52.105352 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d056aabd-aae0-461f-9a49-ec25f7492ee5 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.145862 Sep 28 16:06:52.105909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 655/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:51 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:52.769726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:06:52.770661 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=8 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:06:52.889701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-0499e02b-6e97-4e27-b737-e6fee6beb34b req-0a81a49c-d845-4018-b7bd-50b83d18ce2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeee041c-03df-4be6-8b5f-95340ea8b2c2", "name": "network-vif-plugged", "status": "completed", "tag": "737f6027-0cd0-4a56-98f1-292b3f552d8e"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:06:52.899324 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0499e02b-6e97-4e27-b737-e6fee6beb34b req-0a81a49c-d845-4018-b7bd-50b83d18ce2d service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:52.899790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0499e02b-6e97-4e27-b737-e6fee6beb34b req-0a81a49c-d845-4018-b7bd-50b83d18ce2d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:52.900212 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-0499e02b-6e97-4e27-b737-e6fee6beb34b req-0a81a49c-d845-4018-b7bd-50b83d18ce2d service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:52.914854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-0499e02b-6e97-4e27-b737-e6fee6beb34b req-0a81a49c-d845-4018-b7bd-50b83d18ce2d service nova] Creating event network-vif-plugged:737f6027-0cd0-4a56-98f1-292b3f552d8e for instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 on hv-cinder-85931 Sep 28 16:06:52.921151 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-0499e02b-6e97-4e27-b737-e6fee6beb34b req-0a81a49c-d845-4018-b7bd-50b83d18ce2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155902 Sep 28 16:06:52.921745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 656/1055] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:06:53.129998 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:53.130793 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:53.137087 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:53.137405 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:53.137842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:53.139200 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:53.139566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:53.139985 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:53.276934 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:53.284570 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-17a5e3a0-896a-40a5-a9f0-2009fc0e71ef tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.159371 Sep 28 16:06:53.285134 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 657/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:53 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:54.306300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:54.307000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:54.314334 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:54.314840 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:54.315270 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:54.315950 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:54.316394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:54.316805 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:54.448130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:54.455817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5ca45598-6fe7-422b-abfe-065aab8779f3 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1315 microversion: 2.1 time: 0.153387 Sep 28 16:06:54.456382 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 658/1057] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:54 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:55.477025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:55.477679 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:55.484965 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:55.485340 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:55.485761 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:55.486460 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:55.486889 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:55.487295 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:55.616000 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:55.623848 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-53535b62-d92f-4cee-b065-e0dfb3f4a5fc tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1464 microversion: 2.1 time: 0.150644 Sep 28 16:06:55.624420 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 659/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:55 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:55.670845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:55.671341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:55.677330 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:55.677807 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:55.678237 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:55.678958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:55.679411 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:55.679836 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:55.705556 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 16:06:55.780837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-3a66eeb8-6140-4d02-959f-3f24b4d8d884 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 204 len: 0 microversion: 2.1 time: 0.114148 Sep 28 16:06:55.781695 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 660/1059] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:06:55 2022] DELETE /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 16:06:55.789840 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:55.790559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:55.796393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:55.796867 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:55.797300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:55.797983 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:55.798484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:55.798912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:55.927323 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:55.935024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-7d96b470-c467-4504-beb1-b6f5a0c4dd80 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1470 microversion: 2.1 time: 0.149206 Sep 28 16:06:55.935596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 661/1060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:55 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:56.957708 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:56.958395 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:56.964736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:56.965205 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:56.965632 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:56.966356 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:56.966830 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:56.967243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:57.104670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:57.108509 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:06:57.113351 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-149145af-0b38-4f02-9956-259c455dfcbb tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1470 microversion: 2.1 time: 0.159482 Sep 28 16:06:57.113954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 662/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:56 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:06:58.100786 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-20a27ba5-e497-46d0-9524-9739b5cdfe89 req-f2af378e-04e5-4b5a-a748-69b20212c4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeee041c-03df-4be6-8b5f-95340ea8b2c2", "name": "network-vif-deleted", "tag": "737f6027-0cd0-4a56-98f1-292b3f552d8e"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:06:58.113573 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-20a27ba5-e497-46d0-9524-9739b5cdfe89 req-f2af378e-04e5-4b5a-a748-69b20212c4ed service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:58.114058 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-20a27ba5-e497-46d0-9524-9739b5cdfe89 req-f2af378e-04e5-4b5a-a748-69b20212c4ed service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:58.114559 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-20a27ba5-e497-46d0-9524-9739b5cdfe89 req-f2af378e-04e5-4b5a-a748-69b20212c4ed service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:58.142366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-20a27ba5-e497-46d0-9524-9739b5cdfe89 req-f2af378e-04e5-4b5a-a748-69b20212c4ed service nova] Creating event network-vif-deleted:737f6027-0cd0-4a56-98f1-292b3f552d8e for instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 on hv-cinder-85931 Sep 28 16:06:58.147925 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-20a27ba5-e497-46d0-9524-9739b5cdfe89 req-f2af378e-04e5-4b5a-a748-69b20212c4ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051039 Sep 28 16:06:58.148561 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 663/1062] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:06:58.153966 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:58.154697 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:58.166003 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:58.166691 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:58.167240 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:58.168258 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:58.168879 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:58.170093 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:58.242278 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d2ed0f86f141d299e5440bc54eb31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5edadda817042b1af27039d30e8fa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:06:58.251538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-72f20615-ff82-4e8d-b2cd-f5c7761bce52 tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 200 len: 1300 microversion: 2.1 time: 0.101594 Sep 28 16:06:58.252790 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 664/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:58 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:06:59.275652 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:06:59.276310 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] [instance: aeee041c-03df-4be6-8b5f-95340ea8b2c2] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:06:59.283069 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:59.283552 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:59.283980 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:59.284678 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:06:59.285120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:06:59.285538 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:06:59.300396 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] HTTP exception thrown: Instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 could not be found. Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Request method failure captured: Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 HTTP/1.1 Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNHEQOzWEkOm28gmMpQ8hXh1GKtGrv_-CS0-0eLYsd79-jDDn-ThIgDcMfg9DwTmZL1f6HThYGy9YDtlvdMt7Y5yGbh4xUgu-3lpSLg8twa60to1cDE89WK7IwY6gGCRocV_Y_hnKwWlBuQn4YEz4_mjTPMpL8VD8tMMEknhWxhNXANg Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: c5edadda817042b1af27039d30e8fa68 Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesNegativeTest-936484751 Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:06:59.302061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c5edadda817042b1af27039d30e8fa68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c5edadda817042b1af27039d30e8fa68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c5edadda817042b1af27039d30e8fa68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c5edadda817042b1af27039d30e8fa68"}]}] Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesNegativeTest-936484751 Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: c5edadda817042b1af27039d30e8fa68 Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesNegativeTest-936484751 Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesNegativeTest-936484751-project Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 21d2ed0f86f141d299e5440bc54eb31b Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesNegativeTest-936484751-project Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 could not be found. Sep 28 16:06:59.303907 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'aeee041c-03df-4be6-8b5f-95340ea8b2c2'} Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 could not be found. Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:06:59.305060 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 could not be found. Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 could not be found. Sep 28 16:06:59.306802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:06:59.308375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] Returning 404 to user: Instance aeee041c-03df-4be6-8b5f-95340ea8b2c2 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:06:59.308375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-f0800d90-f5bd-4423-b31b-ea1644f6f7ec tempest-VolumesNegativeTest-936484751 tempest-VolumesNegativeTest-936484751-project] 10.222.0.60 "GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2" status: 404 len: 111 microversion: 2.1 time: 0.031931 Sep 28 16:06:59.308375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 665/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:06:59 2022] GET /compute/v2.1/servers/aeee041c-03df-4be6-8b5f-95340ea8b2c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 16:07:07.021781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-538388083", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "networks": [{"uuid": "51348fc6-050b-45e5-a552-14f8fff81c43"}]}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:07:07.080802 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.network.neutron [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] validate_networks() for [('51348fc6-050b-45e5-a552-14f8fff81c43', None, None, None, None, None)] {{(pid=126996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 16:07:07.441912 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Flavor limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 16:07:07.442581 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Image limits 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 16:07:07.443420 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Flavor pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 16:07:07.444190 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Image pref 0:0:0 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 16:07:07.444940 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.virt.hardware [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 16:07:07.456837 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:07.457315 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:07.457990 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:07.459387 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:07.459845 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:07.460269 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:07.477701 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Getting quotas for project 9c2422a69a09434a80242c7572ba9e13. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:07:07.482317 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.quota [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Getting quotas for user 616d569f5bc24fb8bc5c78128ca4772f and project 9c2422a69a09434a80242c7572ba9e13. Resources: {'instances', 'ram', 'cores'} {{(pid=126996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:07:07.494366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Going to run 1 instances... {{(pid=126996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 16:07:07.496726 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 16:07:07.543148 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5144100f-a18e-4990-8463-ce03a23549bf tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525334 Sep 28 16:07:07.544437 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 666/1065] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 16:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 16:07:07.555129 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-83179cc6-4a40-4ca8-9302-cebade24f95c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:07.555797 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-83179cc6-4a40-4ca8-9302-cebade24f95c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:07.609066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-83179cc6-4a40-4ca8-9302-cebade24f95c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:07.616176 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-83179cc6-4a40-4ca8-9302-cebade24f95c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1218 microversion: 2.1 time: 0.064772 Sep 28 16:07:07.616672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 667/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:07 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:08.638201 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:08.638954 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:08.646209 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:08.647056 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:08.647493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:08.648194 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:08.648705 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:08.649121 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:08.732903 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:08.742693 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fa047a5b-4e82-4630-8174-c6d082d0f580 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1288 microversion: 2.1 time: 0.108255 Sep 28 16:07:08.743504 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 668/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:08 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:09.766495 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:09.767227 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:09.773105 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:09.773588 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:09.774019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:09.774734 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:09.775180 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:09.776222 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:09.985942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:09.993826 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-48e4310b-792b-431c-9855-bbb62fc53b98 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1318 microversion: 2.1 time: 0.231882 Sep 28 16:07:09.994427 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 669/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:09 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:10.018608 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-91cabd50-9c15-4b49-908e-ee5fa890f6de req-2586b9d5-8a61-459e-9e13-f09bfc25d7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5923e91-82d0-45b5-9788-d0ae34a2a129", "tag": "c88abebd-f18c-4bcb-914e-f17abb2c8c74"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:07:10.029817 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-91cabd50-9c15-4b49-908e-ee5fa890f6de req-2586b9d5-8a61-459e-9e13-f09bfc25d7d8 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:10.030381 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-91cabd50-9c15-4b49-908e-ee5fa890f6de req-2586b9d5-8a61-459e-9e13-f09bfc25d7d8 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:10.030841 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-91cabd50-9c15-4b49-908e-ee5fa890f6de req-2586b9d5-8a61-459e-9e13-f09bfc25d7d8 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:10.041787 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-91cabd50-9c15-4b49-908e-ee5fa890f6de req-2586b9d5-8a61-459e-9e13-f09bfc25d7d8 service nova] Creating event network-changed:c88abebd-f18c-4bcb-914e-f17abb2c8c74 for instance e5923e91-82d0-45b5-9788-d0ae34a2a129 on hv-cinder-85931 Sep 28 16:07:10.046685 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-91cabd50-9c15-4b49-908e-ee5fa890f6de req-2586b9d5-8a61-459e-9e13-f09bfc25d7d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031675 Sep 28 16:07:10.047338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 670/1069] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:07:11.019771 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:11.020469 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:11.026897 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:11.027386 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:11.027825 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:11.029104 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:11.029558 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:11.029977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:11.161909 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:11.169543 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-9acfaa6a-266c-4ab4-9d29-e6508a732978 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1318 microversion: 2.1 time: 0.154475 Sep 28 16:07:11.170118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 671/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:11 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:07:12.191612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:12.192295 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:12.198629 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:12.199098 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:12.199527 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:12.200832 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:12.201272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:12.201686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:12.333674 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:12.342019 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d92332cf-9be6-484c-9ecc-8f85b629f6ba tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1318 microversion: 2.1 time: 0.154447 Sep 28 16:07:12.342612 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 672/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:12 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:13.364624 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:13.365300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:13.367695 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:07:13.373390 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:13.373863 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:13.374296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:13.375008 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:13.375448 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:13.375861 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:13.503429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:13.517316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c952def8-b3d4-4084-8522-3974090fb1c4 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1318 microversion: 2.1 time: 0.150635 Sep 28 16:07:13.517316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 673/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:13 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:14.539967 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:14.540611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:14.547503 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:14.547972 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:14.548398 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:14.549071 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:14.549513 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:14.549919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:14.683100 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:14.691659 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-d0ff5ed0-cb63-4c88-a299-cee114bd8d8c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1318 microversion: 2.1 time: 0.155620 Sep 28 16:07:14.692236 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 674/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:14 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:15.714839 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:15.715534 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:15.722321 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:15.722820 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:15.723244 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:15.723919 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:15.724358 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:15.724769 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:15.852958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:15.861281 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-4ab21ff2-c0ae-422b-acfd-240a5525e01b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1318 microversion: 2.1 time: 0.150449 Sep 28 16:07:15.861854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 675/1074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:15 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:16.772109 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-e070001f-9a06-49d1-b8e7-944b72503257 req-e95afc93-d971-490a-aae5-c1553e73069a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5923e91-82d0-45b5-9788-d0ae34a2a129", "name": "network-vif-plugged", "status": "completed", "tag": "c88abebd-f18c-4bcb-914e-f17abb2c8c74"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:07:16.783006 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e070001f-9a06-49d1-b8e7-944b72503257 req-e95afc93-d971-490a-aae5-c1553e73069a service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:16.783492 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e070001f-9a06-49d1-b8e7-944b72503257 req-e95afc93-d971-490a-aae5-c1553e73069a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:16.783927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-e070001f-9a06-49d1-b8e7-944b72503257 req-e95afc93-d971-490a-aae5-c1553e73069a service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:16.795636 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-e070001f-9a06-49d1-b8e7-944b72503257 req-e95afc93-d971-490a-aae5-c1553e73069a service nova] Creating event network-vif-plugged:c88abebd-f18c-4bcb-914e-f17abb2c8c74 for instance e5923e91-82d0-45b5-9788-d0ae34a2a129 on hv-cinder-85931 Sep 28 16:07:16.800402 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-e070001f-9a06-49d1-b8e7-944b72503257 req-e95afc93-d971-490a-aae5-c1553e73069a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032386 Sep 28 16:07:16.801012 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 676/1075] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:07:16.884580 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:16.885196 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:16.891511 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:16.891997 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:16.892429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:16.893120 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:16.893567 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:16.893996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:17.074493 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:17.082110 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-adbbceab-26cb-4f08-a2f7-0d1686c63270 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1318 microversion: 2.1 time: 0.201853 Sep 28 16:07:17.082716 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 677/1076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:16 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:18.105304 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:18.106002 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:18.107941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:07:18.108665 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=8 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:07:18.115394 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:18.115896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:18.116325 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:18.117012 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:18.117455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:18.117876 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:18.255341 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:18.264193 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-5a404fff-afca-4d7f-a59a-66841468408f tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1318 microversion: 2.1 time: 0.162762 Sep 28 16:07:18.265036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 678/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:18 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:19.287340 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:07:19.287989 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:19.294404 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:19.294927 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:19.295338 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:19.296025 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:19.296473 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:19.296896 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:19.427086 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:07:19.435428 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c7ecfa6d-d6da-4803-81ff-57b43884eb74 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1506 microversion: 2.1 time: 0.151331 Sep 28 16:07:19.436002 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 679/1078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:07:19 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:07:38.860126 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99f52a39-10fb-4542-a561-72d162dd6c6d", "device": "/dev/sdb"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:07:38.863134 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:07:38.865451 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=13 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:07:38.866130 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=76 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:07:38.871770 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:38.872486 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:38.872672 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:38.873364 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:07:38.874380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:07:38.874833 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:07:39.137988 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-50310154-cf6a-4826-8adc-de654a5483a2 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "POST /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282161 Sep 28 16:07:39.144328 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 680/1079] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 16:07:38 2022] POST /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:08:00.886996 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG neutronclient.v2_0.client [None req-70c64e33-a5d4-49a6-8de9-0e3fa21ba65c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=126997) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 28 16:08:00.887781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-70c64e33-a5d4-49a6-8de9-0e3fa21ba65c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.426152 Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack [None req-70c64e33-a5d4-49a6-8de9-0e3fa21ba65c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack Traceback (most recent call last): Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack raise client_exc(message=error_message, Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-727a3e73-25df-4255-a903-5e820ba93a02'] Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack Traceback (most recent call last): Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return req.get_response(self.application) Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 28 16:08:00.937292 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack self._log_req(req, res, start) Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack self.force_reraise() Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack raise self.value Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack res = req.get_response(self.application) Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 28 16:08:00.939105 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return resp(environ, start_response) Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return request.get_response(self.application) Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack response = req.get_response(self._app) Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 28 16:08:00.940563 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return resp(environ, start_response) Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return resp(environ, start_response) Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack response = self.app(environ, start_response) Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return resp(environ, start_response) Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Sep 28 16:08:00.942054 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return method(req=request, **action_args) Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return f(*args, **kwargs) Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack [Previous line repeated 10 more times] Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self._create_instance( Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Sep 28 16:08:00.943840 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2626, in validate_networks Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack ports_needed_per_instance = self._ports_needed_per_instance( Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2548, in _ports_needed_per_instance Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack nets = self._get_available_networks( Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 454, in _get_available_networks Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack nets = neutron.list_networks(**search_opts).get('networks', []) Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 860, in list_networks Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self.list('networks', self.networks_path, retrieve_all, Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack res = self.get(path, params=params) Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 28 16:08:00.945686 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack raise exception.Unauthorized() Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack Sep 28 16:08:00.947294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack [None req-70c64e33-a5d4-49a6-8de9-0e3fa21ba65c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] http://10.222.0.60/compute/v2.1/servers returned with HTTP 401 Sep 28 16:08:00.948488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-70c64e33-a5d4-49a6-8de9-0e3fa21ba65c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:08:00.948488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:08:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 28 16:08:00.948488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:08:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.60) Sep 28 16:08:00.948488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: CRITICAL nova [None req-70c64e33-a5d4-49a6-8de9-0e3fa21ba65c tempest-TestVolumeBootPattern-1295971202 tempest-TestVolumeBootPattern-1295971202-project] Unhandled error: OSError: write error Sep 28 16:08:00.948488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova OSError: write error Sep 28 16:08:00.948488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova Sep 28 16:08:00.948488 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 400/1080] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 15:53:00 2022] POST /compute/v2.1/servers => generated 0 bytes in 900479 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Sep 28 16:08:05.961393 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:05.962633 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:05.967429 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:05.968015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:05.976173 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:05.976638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:05.977070 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:05.977759 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:05.978209 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:05.978670 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:06.115143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.objects.instance [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lazy-loading 'services' on Instance uuid e5923e91-82d0-45b5-9788-d0ae34a2a129 {{(pid=126996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 16:08:06.187428 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e8bab2f5-bf53-4f24-80ce-4af8ef4bd0a6 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129/os-volume_attachments/99f52a39-10fb-4542-a561-72d162dd6c6d" status: 202 len: 0 microversion: 2.1 time: 0.228028 Sep 28 16:08:06.188296 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 681/1081] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 16:08:05 2022] DELETE /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129/os-volume_attachments/99f52a39-10fb-4542-a561-72d162dd6c6d => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 16:08:07.313979 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:07.314577 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:07.320640 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:07.321118 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:07.321553 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:07.322253 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:07.322736 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:07.323154 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:07.349392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Going to try to terminate instance {{(pid=126997) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 16:08:07.425991 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-71e3a920-aa04-45a6-8209-44fa57de4aee tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 204 len: 0 microversion: 2.1 time: 0.117049 Sep 28 16:08:07.427031 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 401/1082] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:08:07 2022] DELETE /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 16:08:07.437108 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:07.438054 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:07.444686 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:07.445260 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:07.445609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:07.446300 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:07.446781 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:07.447203 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:07.576714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:07.584821 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-a1fc4c9a-226e-4709-b0bd-a6504465d52a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1512 microversion: 2.1 time: 0.153100 Sep 28 16:08:07.585380 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 682/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:07 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:08.608762 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:08.609372 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:08.616184 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:08.616697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:08.617131 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:08.617809 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:08.618256 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:08.618724 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:08.757108 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:08.764781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8d3d049e-72c5-469f-8d5e-dafc3df1ee2d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1512 microversion: 2.1 time: 0.160389 Sep 28 16:08:08.765342 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 402/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:08 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:09.694195 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [req-276fb03a-1420-4315-822d-ea8779c57d0d req-20927b71-bcf2-4733-883f-5f34784a823c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5923e91-82d0-45b5-9788-d0ae34a2a129", "name": "network-vif-deleted", "tag": "c88abebd-f18c-4bcb-914e-f17abb2c8c74"}]} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:08:09.710053 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-276fb03a-1420-4315-822d-ea8779c57d0d req-20927b71-bcf2-4733-883f-5f34784a823c service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:09.710573 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-276fb03a-1420-4315-822d-ea8779c57d0d req-20927b71-bcf2-4733-883f-5f34784a823c service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:09.710996 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [req-276fb03a-1420-4315-822d-ea8779c57d0d req-20927b71-bcf2-4733-883f-5f34784a823c service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:09.723788 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.compute.server_external_events [req-276fb03a-1420-4315-822d-ea8779c57d0d req-20927b71-bcf2-4733-883f-5f34784a823c service nova] Creating event network-vif-deleted:c88abebd-f18c-4bcb-914e-f17abb2c8c74 for instance e5923e91-82d0-45b5-9788-d0ae34a2a129 on hv-cinder-85931 Sep 28 16:08:09.730500 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [req-276fb03a-1420-4315-822d-ea8779c57d0d req-20927b71-bcf2-4733-883f-5f34784a823c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042680 Sep 28 16:08:09.731255 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 683/1085] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:08:09.787721 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:09.788337 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:09.794943 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:09.795458 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:09.795890 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:09.796578 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:09.797027 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:09.797447 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:09.829294 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:09.829994 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:09.830716 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:09.831383 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lazy-loading 'fault' on Instance uuid e5923e91-82d0-45b5-9788-d0ae34a2a129 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 16:08:09.873225 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:09.881799 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e894f6fb-277c-418b-8a19-15d4d3a69f56 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 200 len: 1308 microversion: 2.1 time: 0.097921 Sep 28 16:08:09.882379 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 403/1086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:09 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:10.906037 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:10.906763 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: e5923e91-82d0-45b5-9788-d0ae34a2a129] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:10.912977 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:10.913452 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:10.913882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:10.914596 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:10.915041 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:10.915455 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:10.928379 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.wsgi [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] HTTP exception thrown: Instance e5923e91-82d0-45b5-9788-d0ae34a2a129 could not be found. Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Request method failure captured: Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: request: GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 HTTP/1.1 Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept: application/json Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Accept-Encoding: identity Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Connection: close Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Length: 0 Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Content-Type: application/json Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Host: 10.222.0.60 Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: Openstack-System-Scope: None Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: User-Agent: python-urllib3/1.26.12 Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Auth-Token: gAAAAABjNHEp_elAXtkPGFozBY5gVHVHwmTtyyHSYVi0gQN2o5TBh-QWEZyKTihwAQcMMEQfkhJ6TAbBPaYv3sVc1OF-_QEbDkJB3hm2tFRUEpwkChIR8x9Fxs9UIXvY4HLa82Lx-XZnVVO6QefxhgprMCjz4KrRrg5K0g9WROI0_ikAZxS3GgQ Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Id: None Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Domain-Name: None Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Identity-Status: Confirmed Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Is-Admin-Project: True Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Id: default Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Domain-Name: Default Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Id: 9c2422a69a09434a80242c7572ba9e13 Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1016401134 Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Role: reader,member Sep 28 16:08:10.929958 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Roles: reader,member Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c2422a69a09434a80242c7572ba9e13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c2422a69a09434a80242c7572ba9e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c2422a69a09434a80242c7572ba9e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c2422a69a09434a80242c7572ba9e13"}]}] Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant: tempest-VolumesSnapshotTestJSON-1016401134 Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Id: 9c2422a69a09434a80242c7572ba9e13 Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1016401134 Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User: tempest-VolumesSnapshotTestJSON-1016401134-project Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Id: default Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Domain-Name: Default Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Id: 616d569f5bc24fb8bc5c78128ca4772f Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: X-User-Name: tempest-VolumesSnapshotTestJSON-1016401134-project Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: method: > Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: exception: Instance e5923e91-82d0-45b5-9788-d0ae34a2a129 could not be found. Sep 28 16:08:10.931838 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: action_args: {'id': 'e5923e91-82d0-45b5-9788-d0ae34a2a129'} Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5923e91-82d0-45b5-9788-d0ae34a2a129 could not be found. Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:08:10.932945 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5923e91-82d0-45b5-9788-d0ae34a2a129 could not be found. Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5923e91-82d0-45b5-9788-d0ae34a2a129 could not be found. Sep 28 16:08:10.934611 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: ERROR nova.api.openstack.wsgi Sep 28 16:08:10.935902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Returning 404 to user: Instance e5923e91-82d0-45b5-9788-d0ae34a2a129 could not be found. {{(pid=126996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:08:10.935902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-2d1c6889-4275-4d2f-abeb-a370e1982c09 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129" status: 404 len: 111 microversion: 2.1 time: 0.029982 Sep 28 16:08:10.935902 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 684/1087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:10 2022] GET /compute/v2.1/servers/e5923e91-82d0-45b5-9788-d0ae34a2a129 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 16:08:20.783567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1447449485", "imageRef": "abe93bf6-6bf7-4208-a6d6-34413347b03f", "flavorRef": "452", "networks": [{"uuid": "51348fc6-050b-45e5-a552-14f8fff81c43"}]}} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:08:20.792712 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:20.793374 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:20.840101 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.network.neutron [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] validate_networks() for [('51348fc6-050b-45e5-a552-14f8fff81c43', None, None, None, None, None)] {{(pid=126997) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 16:08:21.246075 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Flavor limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 16:08:21.246455 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Image limits 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 16:08:21.246950 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Flavor pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 16:08:21.247350 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Image pref 0:0:0 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 16:08:21.247751 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.virt.hardware [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 16:08:21.256576 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:21.257039 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:21.257457 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:21.258161 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:21.258628 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:21.259043 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:21.275851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Getting quotas for project 9c2422a69a09434a80242c7572ba9e13. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 16:08:21.279741 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.quota [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Getting quotas for user 616d569f5bc24fb8bc5c78128ca4772f and project 9c2422a69a09434a80242c7572ba9e13. Resources: {'instances', 'ram', 'cores'} {{(pid=126997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 16:08:21.291140 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Going to run 1 instances... {{(pid=126997) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 16:08:21.293416 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe93bf6-6bf7-4208-a6d6-34413347b03f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 16:08:21.337265 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [3d624a7d-2d0f-450e-9b4e-3b54b38234f1] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 16:08:22.344312 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [3d624a7d-2d0f-450e-9b4e-3b54b38234f1] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44384. Sep 28 16:08:22.349010 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-5dc5ede8-c17a-4014-b8df-7459b55ead42 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569866 Sep 28 16:08:22.349660 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 404/1088] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 28 16:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 16:08:22.361375 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-c73d727e-c440-416d-a4e6-b6091de2c13c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:22.361984 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-c73d727e-c440-416d-a4e6-b6091de2c13c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:22.364373 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=8 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:22.365188 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:22.425877 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-c73d727e-c440-416d-a4e6-b6091de2c13c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:22.434981 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-c73d727e-c440-416d-a4e6-b6091de2c13c tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1219 microversion: 2.1 time: 0.078274 Sep 28 16:08:22.435550 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 685/1089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:22 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:23.457892 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:23.458620 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:23.465622 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:23.466428 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:23.466996 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:23.467948 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:23.468471 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:23.468965 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:23.549239 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:23.557047 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-e69b97cb-29a3-47de-8c62-314ddfbc0a65 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1289 microversion: 2.1 time: 0.103842 Sep 28 16:08:23.557620 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 405/1090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:23 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:24.581641 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:24.582453 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:24.589638 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:24.590119 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:24.590582 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:24.591319 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:24.591767 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:24.592192 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:24.798547 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:24.807064 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-16eade4f-bb93-43e7-a3e0-a92012430046 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1319 microversion: 2.1 time: 0.230203 Sep 28 16:08:24.807736 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 686/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:24 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:25.093098 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-225cdf80-eca4-4f5b-8c38-8d14b7494cc2 req-bc8b66bd-4df6-428c-be19-e020380337fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b48091-b50a-4679-bdf8-e9c7ad5e5969", "tag": "5ed324a5-e4ff-4db8-a312-a38992417dfb"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:08:25.106580 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-225cdf80-eca4-4f5b-8c38-8d14b7494cc2 req-bc8b66bd-4df6-428c-be19-e020380337fb service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:25.107451 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-225cdf80-eca4-4f5b-8c38-8d14b7494cc2 req-bc8b66bd-4df6-428c-be19-e020380337fb service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:25.108197 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-225cdf80-eca4-4f5b-8c38-8d14b7494cc2 req-bc8b66bd-4df6-428c-be19-e020380337fb service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:25.125708 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-225cdf80-eca4-4f5b-8c38-8d14b7494cc2 req-bc8b66bd-4df6-428c-be19-e020380337fb service nova] Creating event network-changed:5ed324a5-e4ff-4db8-a312-a38992417dfb for instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 on hv-cinder-85931 Sep 28 16:08:25.134010 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-225cdf80-eca4-4f5b-8c38-8d14b7494cc2 req-bc8b66bd-4df6-428c-be19-e020380337fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044791 Sep 28 16:08:25.134860 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 406/1092] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:08:25.831809 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:25.832398 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:25.839230 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:25.839713 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:25.840140 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:25.840842 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:25.841286 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:25.841737 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:25.971189 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:25.978799 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-0f05f7df-33e8-4750-a5a8-4e87cd6d9c10 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1319 microversion: 2.1 time: 0.151340 Sep 28 16:08:25.979370 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 687/1093] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:25 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:27.001657 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:27.002336 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:27.008816 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:27.009279 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:27.009697 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:27.010392 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:27.010851 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:27.011259 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:27.146626 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:27.154178 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-a649bc71-f4c8-4039-bdca-4c9d474e9809 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1319 microversion: 2.1 time: 0.156780 Sep 28 16:08:27.154776 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 407/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:26 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:28.177698 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:28.178314 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:28.184798 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:28.185272 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:28.185703 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:28.186389 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:28.186868 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:28.187287 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:28.320484 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:28.328061 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-e4142c53-2866-4333-b142-6262a764be87 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1319 microversion: 2.1 time: 0.154550 Sep 28 16:08:28.328634 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 688/1095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:28 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:29.351804 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:29.352391 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:29.354884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 16:08:29.355048 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Wed Sep 28 16:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 (ip 10.222.0.60) !!! Sep 28 16:08:29.362779 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:29.363289 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:29.363717 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:29.364407 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:29.364878 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:29.365327 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:29.495680 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:29.504270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-1241d753-b08d-4339-a5c6-d7956a01c8ea tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1319 microversion: 2.1 time: 0.156075 Sep 28 16:08:29.504780 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 408/1096] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:29 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:30.528155 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:30.528714 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:30.535004 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:30.535566 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:30.536015 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:30.536585 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:30.537024 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:30.537437 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:30.668731 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:30.676942 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-cd9a951f-f939-48db-a445-6823c6b9df3b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1319 microversion: 2.1 time: 0.152695 Sep 28 16:08:30.677507 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 689/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:30 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:31.071237 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-3c6211b5-38e8-4d77-8e18-4f3340e9a8fe req-e33c8c42-d9ad-44cc-bf8f-0b6a1639b8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b48091-b50a-4679-bdf8-e9c7ad5e5969", "name": "network-vif-plugged", "status": "completed", "tag": "5ed324a5-e4ff-4db8-a312-a38992417dfb"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:08:31.081950 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-3c6211b5-38e8-4d77-8e18-4f3340e9a8fe req-e33c8c42-d9ad-44cc-bf8f-0b6a1639b8d7 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:31.082643 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-3c6211b5-38e8-4d77-8e18-4f3340e9a8fe req-e33c8c42-d9ad-44cc-bf8f-0b6a1639b8d7 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:31.083068 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-3c6211b5-38e8-4d77-8e18-4f3340e9a8fe req-e33c8c42-d9ad-44cc-bf8f-0b6a1639b8d7 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:31.095340 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-3c6211b5-38e8-4d77-8e18-4f3340e9a8fe req-e33c8c42-d9ad-44cc-bf8f-0b6a1639b8d7 service nova] Creating event network-vif-plugged:5ed324a5-e4ff-4db8-a312-a38992417dfb for instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 on hv-cinder-85931 Sep 28 16:08:31.101288 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-3c6211b5-38e8-4d77-8e18-4f3340e9a8fe req-e33c8c42-d9ad-44cc-bf8f-0b6a1639b8d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033869 Sep 28 16:08:31.102772 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 409/1098] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:08:31.700196 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:31.700811 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:31.708118 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:31.708595 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:31.709023 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:31.709745 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:31.710167 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:31.710615 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:31.844052 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:31.851854 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-644d65a5-f9f6-4937-a7da-524e96e0383a tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1319 microversion: 2.1 time: 0.155608 Sep 28 16:08:31.852422 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 690/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:31 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:08:32.875140 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:32.875847 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:32.877876 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=2 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:32.878569 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell0:SELECT=6 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:32.885781 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:32.886260 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:32.886720 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:32.887414 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:32.887868 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:32.888287 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:33.020792 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:33.030005 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-f70cbfda-2ef7-4425-bfe1-bce8fa6a6047 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1508 microversion: 2.1 time: 0.158245 Sep 28 16:08:33.030960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 410/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:32 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:33.052960 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ba3f2cf-b385-495b-9bc2-eb461728a857", "device": "/dev/sdb"}} {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:08:33.055609 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:33.057560 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell0:SELECT=2 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:33.063895 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:33.064378 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:33.064806 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:33.065499 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:33.065948 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:33.066366 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:33.323002 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-fbd66b2d-5aab-4e13-bdde-48eeec383e39 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "POST /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273795 Sep 28 16:08:33.323893 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 691/1101] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 28 16:08:33 2022] POST /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 16:08:54.778539 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:54.779067 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:54.782162 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:54.782960 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG dbcounter [-] [126997] Writing DB stats nova_cell1:SELECT=30 {{(pid=126997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:54.790088 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:54.790609 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:54.791041 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:54.791733 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:54.792183 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:54.792606 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:54.873754 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.objects.instance [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lazy-loading 'services' on Instance uuid 14b48091-b50a-4679-bdf8-e9c7ad5e5969 {{(pid=126997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 16:08:54.946567 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-c80cffc7-2cb2-4242-9f36-e62b8252d845 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969/os-volume_attachments/3ba3f2cf-b385-495b-9bc2-eb461728a857" status: 202 len: 0 microversion: 2.1 time: 0.171757 Sep 28 16:08:54.947159 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 411/1102] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 28 16:08:54 2022] DELETE /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969/os-volume_attachments/3ba3f2cf-b385-495b-9bc2-eb461728a857 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 16:08:56.074656 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_api:SELECT=16 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:56.075476 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG dbcounter [-] [126996] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 16:08:56.079702 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:56.080284 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:56.088482 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:56.088959 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:56.089385 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:56.090066 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:56.090532 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:56.090960 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:56.119100 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Going to try to terminate instance {{(pid=126996) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 16:08:56.193243 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-118aac46-af98-434e-ab0d-79649e8b749d tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 204 len: 0 microversion: 2.1 time: 0.119429 Sep 28 16:08:56.194160 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 692/1103] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 28 16:08:56 2022] DELETE /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 16:08:56.203231 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:56.203918 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:56.210685 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:56.211163 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:56.211590 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:56.212271 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:56.212715 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:56.213126 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:56.346925 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.policy [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126997) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:56.354670 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-8c126486-9b83-4177-bd82-207eb44bbd47 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1514 microversion: 2.1 time: 0.156117 Sep 28 16:08:56.355229 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 412/1104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:56 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 16:08:57.377975 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:57.378685 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:57.385316 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:57.385796 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:57.386226 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:57.386952 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:57.387397 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:57.387816 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:57.521007 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:57.528941 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-52528bde-5c09-4780-8e6a-0e8a2332913b tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1514 microversion: 2.1 time: 0.155173 Sep 28 16:08:57.529518 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 693/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:57 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:58.511007 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [req-33a9e228-1351-42aa-826b-be46dc583067 req-9d58c4db-1f68-45fc-af5d-f6fda540fad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b48091-b50a-4679-bdf8-e9c7ad5e5969", "name": "network-vif-deleted", "tag": "5ed324a5-e4ff-4db8-a312-a38992417dfb"}]} {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 16:08:58.520976 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-33a9e228-1351-42aa-826b-be46dc583067 req-9d58c4db-1f68-45fc-af5d-f6fda540fad0 service nova] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:58.521444 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-33a9e228-1351-42aa-826b-be46dc583067 req-9d58c4db-1f68-45fc-af5d-f6fda540fad0 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:58.521866 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [req-33a9e228-1351-42aa-826b-be46dc583067 req-9d58c4db-1f68-45fc-af5d-f6fda540fad0 service nova] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:58.532943 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.compute.server_external_events [req-33a9e228-1351-42aa-826b-be46dc583067 req-9d58c4db-1f68-45fc-af5d-f6fda540fad0 service nova] Creating event network-vif-deleted:5ed324a5-e4ff-4db8-a312-a38992417dfb for instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 on hv-cinder-85931 Sep 28 16:08:58.538526 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [req-33a9e228-1351-42aa-826b-be46dc583067 req-9d58c4db-1f68-45fc-af5d-f6fda540fad0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031123 Sep 28 16:08:58.539153 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 413/1106] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 28 16:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 16:08:58.552882 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.api.openstack.wsgi [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:58.553551 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.compute.api [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126996) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:58.560036 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:58.560522 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:58.562009 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:58.563261 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:58.563720 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:58.564143 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG oslo_concurrency.lockutils [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:58.643158 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: DEBUG nova.policy [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616d569f5bc24fb8bc5c78128ca4772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2422a69a09434a80242c7572ba9e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126996) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 16:08:58.653107 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: INFO nova.api.openstack.requestlog [None req-78681b71-c321-48ba-a21d-830b89d12a29 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 200 len: 1304 microversion: 2.1 time: 0.104664 Sep 28 16:08:58.653693 dv-cinder-859316-1-iscsi devstack@n-api.service[126996]: [pid: 126996|app: 0|req: 694/1107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:58 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 16:08:59.677653 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Calling method '>' {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 16:08:59.678347 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.compute.api [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] [instance: 14b48091-b50a-4679-bdf8-e9c7ad5e5969] Fetching instance by UUID {{(pid=126997) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 16:08:59.684982 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:59.685459 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:59.685884 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:59.686617 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Acquiring lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 16:08:59.687058 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 16:08:59.687716 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG oslo_concurrency.lockutils [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Lock "87116ee1-0fc8-49a7-9503-1c7e788a9bed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 16:08:59.702828 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.wsgi [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] HTTP exception thrown: Instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 could not be found. Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Request method failure captured: Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: request: GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 HTTP/1.1 Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept: application/json Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Accept-Encoding: identity Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Connection: close Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Length: 0 Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Content-Type: application/json Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Host: 10.222.0.60 Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: Openstack-System-Scope: None Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: User-Agent: python-urllib3/1.26.12 Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Auth-Token: gAAAAABjNHEp_elAXtkPGFozBY5gVHVHwmTtyyHSYVi0gQN2o5TBh-QWEZyKTihwAQcMMEQfkhJ6TAbBPaYv3sVc1OF-_QEbDkJB3hm2tFRUEpwkChIR8x9Fxs9UIXvY4HLa82Lx-XZnVVO6QefxhgprMCjz4KrRrg5K0g9WROI0_ikAZxS3GgQ Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Id: None Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Domain-Name: None Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Identity-Status: Confirmed Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Is-Admin-Project: True Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Id: default Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Domain-Name: Default Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Id: 9c2422a69a09434a80242c7572ba9e13 Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1016401134 Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Role: reader,member Sep 28 16:08:59.704541 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Roles: reader,member Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c2422a69a09434a80242c7572ba9e13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c2422a69a09434a80242c7572ba9e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c2422a69a09434a80242c7572ba9e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c2422a69a09434a80242c7572ba9e13"}]}] Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant: tempest-VolumesSnapshotTestJSON-1016401134 Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Id: 9c2422a69a09434a80242c7572ba9e13 Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1016401134 Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User: tempest-VolumesSnapshotTestJSON-1016401134-project Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Id: default Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Domain-Name: Default Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Id: 616d569f5bc24fb8bc5c78128ca4772f Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: X-User-Name: tempest-VolumesSnapshotTestJSON-1016401134-project Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: method: > Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: exception: Instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 could not be found. Sep 28 16:08:59.706270 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: action_args: {'id': '14b48091-b50a-4679-bdf8-e9c7ad5e5969'} Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: {{(pid=126997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 could not be found. Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 16:08:59.707286 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 could not be found. Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 could not be found. Sep 28 16:08:59.708951 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: ERROR nova.api.openstack.wsgi Sep 28 16:08:59.711662 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: DEBUG nova.api.openstack.wsgi [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] Returning 404 to user: Instance 14b48091-b50a-4679-bdf8-e9c7ad5e5969 could not be found. {{(pid=126997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 16:08:59.711662 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: INFO nova.api.openstack.requestlog [None req-6b11ccef-db34-48ac-92db-21ab788654d1 tempest-VolumesSnapshotTestJSON-1016401134 tempest-VolumesSnapshotTestJSON-1016401134-project] 10.222.0.60 "GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969" status: 404 len: 111 microversion: 2.1 time: 0.033583 Sep 28 16:08:59.711662 dv-cinder-859316-1-iscsi devstack@n-api.service[126997]: [pid: 126997|app: 0|req: 414/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 28 16:08:59 2022] GET /compute/v2.1/servers/14b48091-b50a-4679-bdf8-e9c7ad5e5969 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)